Geometric analysis enables biological insight from complex non-identifiable models using simple surrogates.

An enduring challenge in computational biology is to balance data quality and quantity with model complexity. Tools such as identifiability analysis and information criterion have been developed to harmonise this juxtaposition, yet cannot always resolve the mismatch between available data and the granularity required in mathematical models to answer important biological questions. Often, it is only simple phenomenological models, such as the logistic and Gompertz growth models, that are identifiable from standard experimental measurements. To draw insights from complex, non-identifiable models that incorporate key biological mechanisms of interest, we study the geometry of a map in parameter space from the complex model to a simple, identifiable, surrogate model. By studying how non-identifiable parameters in the complex model quantitatively relate to identifiable parameters in surrogate, we introduce and exploit a layer of interpretation between the set of non-identifiable parameters and the goodness-of-fit metric or likelihood studied in typical identifiability analysis. We demonstrate our approach by analysing a hierarchy of mathematical models for multicellular tumour spheroid growth experiments. Typical data from tumour spheroid experiments are limited and noisy, and corresponding mathematical models are very often made arbitrarily complex. Our geometric approach is able to predict non-identifiabilities, classify non-identifiable parameter spaces into identifiable parameter combinations that relate to features in the data characterised by parameters in a surrogate model, and overall provide additional biological insight from complex non-identifiable models.

Predicting Radiotherapy Patient Outcomes with Real-Time Clinical Data Using Mathematical Modelling.

Longitudinal tumour volume data from head-and-neck cancer patients show that tumours of comparable pre-treatment size and stage may respond very differently to the same radiotherapy fractionation protocol. Mathematical models are often proposed to predict treatment outcome in this context, and have the potential to guide clinical decision-making and inform personalised fractionation protocols. Hindering effective use of models in this context is the sparsity of clinical measurements juxtaposed with the model complexity required to produce the full range of possible patient responses. In this work, we present a compartment model of tumour volume and tumour composition, which, despite relative simplicity, is capable of producing a wide range of patient responses. We then develop novel statistical methodology and leverage a cohort of existing clinical data to produce a predictive model of both tumour volume progression and the associated level of uncertainty that evolves throughout a patient's course of treatment. To capture inter-patient variability, all model parameters are patient specific, with a bootstrap particle filter-like Bayesian approach developed to model a set of training data as prior knowledge. We validate our approach against a subset of unseen data, and demonstrate both the predictive ability of our trained model and its limitations.

Efficient inference and identifiability analysis for differential equation models with random parameters.

Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data. Therefore, methods for exploring the identifiability of models that explicitly incorporate heterogeneity through variability in model parameters are relatively underdeveloped. We develop a new likelihood-based framework, based on moment matching, for inference and identifiability analysis of differential equation models that capture biological heterogeneity through parameters that vary according to probability distributions. As our novel method is based on an approximate likelihood function, it is highly flexible; we demonstrate identifiability analysis using both a frequentist approach based on profile likelihood, and a Bayesian approach based on Markov-chain Monte Carlo. Through three case studies, we demonstrate our method by providing a didactic guide to inference and identifiability analysis of hyperparameters that relate to the statistical moments of model parameters from independent observed data. Our approach has a computational cost comparable to analysis of models that neglect heterogeneity, a significant improvement over many existing alternatives. We demonstrate how analysis of random parameter models can aid better understanding of the sources of heterogeneity from biological data.

Parameter identifiability and model selection for sigmoid population growth models.

Sigmoid growth models, such as the logistic, Gompertz and Richards' models, are widely used to study population dynamics ranging from microscopic populations of cancer cells, to continental-scale human populations. Fundamental questions about model selection and parameter estimation are critical if these models are to be used to make practical inferences. However, the question of parameter identifiability - whether a data set contains sufficient information to give unique or sufficiently precise parameter estimates - is often overlooked. We use a profile-likelihood approach to explore practical parameter identifiability using data describing the re-growth of hard coral. With this approach, we explore the relationship between parameter identifiability and model misspecification, finding that the logistic growth model does not suffer identifiability issues for the type of data we consider whereas the Gompertz and Richards' models encounter practical non-identifiability issues. This analysis of parameter identifiability and model selection is important because different growth models are in biological modelling without necessarily considering whether parameters are identifiable. Standard practices that do not consider parameter identifiability can lead to unreliable or imprecise parameter estimates and potentially misleading mechanistic interpretations. For example, using the Gompertz model, the estimate of the time scale of coral re-growth is 625 days when we estimate the initial density from the data, whereas it is 1429 days using a more standard approach where variability in the initial density is ignored. While tools developed here focus on three standard sigmoid growth models only, our theoretical developments are applicable to any sigmoid growth model and any appropriate data set. MATLAB implementations of all software are available on GitHub.

Persistence as an Optimal Hedging Strategy.

Bacteria invest in a slow-growing subpopulation, called persisters, to ensure survival in the face of uncertainty. This hedging strategy is remarkably similar to financial hedging, where diversifying an investment portfolio protects against economic uncertainty. We provide a new, to our knowledge, theoretical foundation for understanding cellular hedging by unifying the study of biological population dynamics and the mathematics of financial risk management through optimal control theory. Motivated by the widely accepted role of volatility in the emergence of persistence, we consider several models of environmental volatility described by continuous-time stochastic processes. This allows us to study an emergent cellular hedging strategy that maximizes the expected per capita growth rate of the population. Analytical and simulation results probe the optimal persister strategy, revealing results that are consistent with experimental observations and suggest new opportunities for experimental investigation and design. Overall, we provide a new, to our knowledge, way of conceptualizing and modeling cellular decision making in volatile environments by explicitly unifying theory from mathematical biology and finance.

Model-based data analysis of tissue growth in thin 3D printed scaffolds.

Tissue growth in three-dimensional (3D) printed scaffolds enables exploration and control of cell behaviour in more biologically realistic geometries than that allowed by traditional 2D cell culture. Cell proliferation and migration in these experiments have yet to be explicitly characterised, limiting the ability of experimentalists to determine the effects of various experimental conditions, such as scaffold geometry, on cell behaviour. We consider tissue growth by osteoblastic cells in melt electro-written scaffolds that comprise thin square pores with sizes that were deliberately increased between experiments. We collect highly detailed temporal measurements of the average cell density, tissue coverage, and tissue geometry. To quantify tissue growth in terms of the underlying cell proliferation and migration processes, we introduce and calibrate a mechanistic mathematical model based on the Porous-Fisher reaction-diffusion equation. Parameter estimates and uncertainty quantification through profile likelihood analysis reveal consistency in the rate of cell proliferation and steady-state cell density between pore sizes. This analysis also serves as an important model verification tool: while the use of reaction-diffusion models in biology is widespread, the appropriateness of these models to describe tissue growth in 3D scaffolds has yet to be explored. We find that the Porous-Fisher model is able to capture features relating to the cell density and tissue coverage, but is not able to capture geometric features relating to the circularity of the tissue interface. Our analysis identifies two distinct stages of tissue growth, suggests several areas for model refinement, and provides guidance for future experimental work that explores tissue growth in 3D printed scaffolds.

Designing combination therapies using multiple optimal controls.

Strategic management of populations of interacting biological species routinely requires interventions combining multiple treatments or therapies. This is important in key research areas such as ecology, epidemiology, wound healing and oncology. Despite the well developed theory and techniques for determining single optimal controls, there is limited practical guidance supporting implementation of combination therapies. In this work we use optimal control theory to calculate optimal strategies for applying combination therapies to a model of acute myeloid leukaemia. We present a versatile framework to systematically explore the trade-offs that arise in designing combination therapy protocols using optimal control. We consider various combinations of continuous and bang-bang (discrete) controls, and we investigate how the control dynamics interact and respond to changes in the weighting and form of the pay-off characterising optimality. We demonstrate that the optimal controls respond non-linearly to treatment strength and control parameters, due to the interactions between species. We discuss challenges in appropriately characterising optimality in a multiple control setting and provide practical guidance for applying multiple optimal controls. Code used in this work to implement multiple optimal controls is available on GitHub.

Optimal control of acute myeloid leukaemia.

Acute myeloid leukaemia (AML) is a blood cancer affecting haematopoietic stem cells. AML is routinely treated with chemotherapy, and so it is of great interest to develop optimal chemotherapy treatment strategies. In this work, we incorporate an immune response into a stem cell model of AML, since we find that previous models lacking an immune response are inappropriate for deriving optimal control strategies. Using optimal control theory, we produce continuous controls and bang-bang controls, corresponding to a range of objectives and parameter choices. Through example calculations, we provide a practical approach to applying optimal control using Pontryagin's Maximum Principle. In particular, we describe and explore factors that have a profound influence on numerical convergence. We find that the convergence behaviour is sensitive to the method of control updating, the nature of the control, and to the relative weighting of terms in the objective function. All codes we use to implement optimal control are made available.

A Bayesian Sequential Learning Framework to Parameterise Continuum Models of Melanoma Invasion into Human Skin.

We present a novel framework to parameterise a mathematical model of cell invasion that describes how a population of melanoma cells invades into human skin tissue. Using simple experimental data extracted from complex experimental images, we estimate three model parameters: (i) the melanoma cell proliferation rate, [Formula: see text]; (ii) the melanoma cell diffusivity, D; and (iii) [Formula: see text], a constant that determines the rate that melanoma cells degrade the skin tissue. The Bayesian sequential learning framework involves a sequence of increasingly sophisticated experimental data from: (i) a spatially uniform cell proliferation assay; (ii) a two-dimensional circular barrier assay; and (iii) a three-dimensional invasion assay. The Bayesian sequential learning approach leads to well-defined parameter estimates. In contrast, taking a naive approach that attempts to estimate all parameters from a single set of images from the same experiment fails to produce meaningful results. Overall, our approach to inference is simple-to-implement, computationally efficient, and well suited for many cell biology phenomena that can be described by low-dimensional continuum models using ordinary differential equations and partial differential equations. We anticipate that this Bayesian sequential learning framework will be relevant in other biological contexts where it is challenging to extract detailed, quantitative biological measurements from experimental images and so we must rely on using relatively simple measurements from complex images.

Inferring parameters for a lattice-free model of cell migration and proliferation using experimental data.

Collective cell spreading takes place in spatially continuous environments, yet it is often modelled using discrete lattice-based approaches. Here, we use data from a series of cell proliferation assays, with a prostate cancer cell line, to calibrate a spatially continuous individual based model (IBM) of collective cell migration and proliferation. The IBM explicitly accounts for crowding effects by modifying the rate of movement, direction of movement, and the rate of proliferation by accounting for pair-wise interactions. Taking a Bayesian approach we estimate the free parameters in the IBM using rejection sampling on three separate, independent experimental data sets. Since the posterior distributions for each experiment are similar, we perform simulations with parameters sampled from a new posterior distribution generated by combining the three data sets. To explore the predictive power of the calibrated IBM, we forecast the evolution of a fourth experimental data set. Overall, we show how to calibrate a lattice-free IBM to experimental data, and our work highlights the importance of interactions between individuals. Despite great care taken to distribute cells as uniformly as possible experimentally, we find evidence of significant spatial clustering over short distances, suggesting that standard mean-field models could be inappropriate.

A Bayesian Computational Approach to Explore the Optimal Duration of a Cell Proliferation Assay.

Cell proliferation assays are routinely used to explore how a low-density monolayer of cells grows with time. For a typical cell line with a doubling time of 12 h (or longer), a standard cell proliferation assay conducted over 24 h provides excellent information about the low-density exponential growth rate, but limited information about crowding effects that occur at higher densities. To explore how we can best detect and quantify crowding effects, we present a suite of in silico proliferation assays where cells proliferate according to a generalised logistic growth model. Using approximate Bayesian computation we show that data from a standard cell proliferation assay cannot reliably distinguish between classical logistic growth and more general non-logistic growth models. We then explore, and quantify, the trade-off between increasing the duration of the experiment and the associated decrease in uncertainty in the crowding mechanism.

Smoothing in linear multicompartment biological processes subject to stochastic input.

Many physical and biological systems rely on the progression of material through multiple independent stages. In viral replication, for example, virions enter a cell to undergo a complex process comprising several disparate stages before the eventual accumulation and release of replicated virions. While such systems may have some control over the internal dynamics that make up this progression, a challenge for many is to regulate behavior under what are often highly variable external environments acting as system inputs. In this work, we study a simple analog of this problem through a linear multicompartment model subject to a stochastic input in the form of a mean-reverting Ornstein-Uhlenbeck process, a type of Gaussian process. By expressing the system as a multidimensional Gaussian process, we derive several closed-form analytical results relating to the covariances and autocorrelations of the system, quantifying the smoothing effect discrete compartments afford multicompartment systems. Semianalytical results demonstrate that feedback and feedforward loops can enhance system robustness, and simulation results probe the intractable problem of the first passage time distribution, which has specific relevance to eventual cell lysis in the viral replication cycle. Finally, we demonstrate that the smoothing seen in the process is a consequence of the discreteness of the system, and does not manifest in systems with continuous transport. While we make progress through analysis of a simple linear problem, many of our insights are applicable more generally, and our work enables future analysis into multicompartment processes subject to stochastic inputs.

Real-Time Cell Cycle Imaging in a 3D Cell Culture Model of Melanoma, Quantitative Analysis, Optical Clearing, and Mathematical Modeling.

Aberrant cell cycle progression is a hallmark of solid tumors. Therefore, cell cycle analysis is an invaluable technique to study cancer cell biology. However, cell cycle progression has been most commonly assessed by methods that are limited to temporal snapshots or that lack spatial information. In this chapter, we describe a technique that allows spatiotemporal real-time tracking of cell cycle progression of individual cells in a multicellular context. The power of this system lies in the use of 3D melanoma spheroids generated from melanoma cells engineered with the fluorescent ubiquitination-based cell cycle indicator (FUCCI). This technique, combined with mathematical modeling, allows us to gain further and more detailed insight into several relevant aspects of solid cancer cell biology, such as tumor growth, proliferation, invasion, and drug sensitivity.

Rapid Optical Clearing for Semi-High-Throughput Analysis of Tumor Spheroids.

Tumor spheroids are fast becoming commonplace in basic cancer research and drug development. Obtaining data regarding protein expression within the spheroid at the cellular level is important for analysis, yet existing techniques are often expensive, laborious, use non-standard equipment, cause significant size distortion, or are limited to relatively small spheroids. This protocol presents a new method of mounting and clearing spheroids that address these issues while allowing for confocal analysis of the inner structure of spheroids. In contrast to existing approaches, this protocol provides for rapid mounting and clearing of a large number of spheroids using standard equipment and laboratory supplies. Mounting spheroids in a pH-neutral agarose-PBS gel solution before introducing a refractive-index-matched clearing solution minimizes size distortion common to other similar techniques. This allows for detailed quantitative and statistical analysis where the accuracy of size measurements is paramount. Furthermore, compared to liquid clearing solutions, the agarose gel technique keeps spheroids fixed in place, allowing for the collection of three-dimensional (3D) confocal images. The present article elaborates how the method yields high-quality two- and 3D images that provide information about inter-cell variability and inner spheroid structure.

Parameter estimation and uncertainty quantification using information geometry.

In this work, we: (i) review likelihood-based inference for parameter estimation and the construction of confidence regions; and (ii) explore the use of techniques from information geometry, including geodesic curves and Riemann scalar curvature, to supplement typical techniques for uncertainty quantification, such as Bayesian methods, profile likelihood, asymptotic analysis and bootstrapping. These techniques from information geometry provide data-independent insights into uncertainty and identifiability, and can be used to inform data collection decisions. All code used in this work to implement the inference and information geometry techniques is available on GitHub.

Designing and interpreting 4D tumour spheroid experiments.

Tumour spheroid experiments are routinely used to study cancer progression and treatment. Various and inconsistent experimental designs are used, leading to challenges in interpretation and reproducibility. Using multiple experimental designs, live-dead cell staining, and real-time cell cycle imaging, we measure necrotic and proliferation-inhibited regions in over 1000 4D tumour spheroids (3D space plus cell cycle status). By intentionally varying the initial spheroid size and temporal sampling frequencies across multiple cell lines, we collect an abundance of measurements of internal spheroid structure. These data are difficult to compare and interpret. However, using an objective mathematical modelling framework and statistical identifiability analysis we quantitatively compare experimental designs and identify design choices that produce reliable biological insight. Measurements of internal spheroid structure provide the most insight, whereas varying initial spheroid size and temporal measurement frequency is less important. Our general framework applies to spheroids grown in different conditions and with different cell types.

Identifying cell-to-cell variability in internalization using flow cytometry.

Biological heterogeneity is a primary contributor to the variation observed in experiments that probe dynamical processes, such as the internalization of material by cells. Given that internalization is a critical process by which many therapeutics and viruses reach their intracellular site of action, quantifying cell-to-cell variability in internalization is of high biological interest. Yet, it is common for studies of internalization to neglect cell-to-cell variability. We develop a simple mathematical model of internalization that captures the dynamical behaviour, cell-to-cell variation, and extrinsic noise introduced by flow cytometry. We calibrate our model through a novel distribution-matching approximate Bayesian computation algorithm to flow cytometry data of internalization of anti-transferrin receptor antibody in a human B-cell lymphoblastoid cell line. This approach provides information relating to the region of the parameter space, and consequentially the nature of cell-to-cell variability, that produces model realizations consistent with the experimental data. Given that our approach is agnostic to sample size and signal-to-noise ratio, our modelling framework is broadly applicable to identify biological variability in single-cell data from internalization assays and similar experiments that probe cellular dynamical processes.

A stochastic mathematical model of 4D tumour spheroids with real-time fluorescent cell cycle labelling.

In vitro tumour spheroids have been used to study avascular tumour growth and drug design for over 50 years. Tumour spheroids exhibit heterogeneity within the growing population that is thought to be related to spatial and temporal differences in nutrient availability. The recent development of real-time fluorescent cell cycle imaging allows us to identify the position and cell cycle status of individual cells within the growing spheroid, giving rise to the notion of a four-dimensional (4D) tumour spheroid. We develop the first stochastic individual-based model (IBM) of a 4D tumour spheroid and show that IBM simulation data compares well with experimental data using a primary human melanoma cell line. The IBM provides quantitative information about nutrient availability within the spheroid, which is important because it is difficult to measure these data experimentally.

Quantitative analysis of tumour spheroid structure.

Tumour spheroids are common in vitro experimental models of avascular tumour growth. Compared with traditional two-dimensional culture, tumour spheroids more closely mimic the avascular tumour microenvironment where spatial differences in nutrient availability strongly influence growth. We show that spheroids initiated using significantly different numbers of cells grow to similar limiting sizes, suggesting that avascular tumours have a limiting structure; in agreement with untested predictions of classical mathematical models of tumour spheroids. We develop a novel mathematical and statistical framework to study the structure of tumour spheroids seeded from cells transduced with fluorescent cell cycle indicators, enabling us to discriminate between arrested and cycling cells and identify an arrested region. Our analysis shows that transient spheroid structure is independent of initial spheroid size, and the limiting structure can be independent of seeding density. Standard experimental protocols compare spheroid size as a function of time; however, our analysis suggests that comparing spheroid structure as a function of overall size produces results that are relatively insensitive to variability in spheroid size. Our experimental observations are made using two melanoma cell lines, but our modelling framework applies across a wide range of spheroid culture conditions and cell lines.