Empirical Quantification of Predictive Uncertainty Due to Model Discrepancy by Training with an Ensemble of Experimental Designs: An Application to Ion Channel Kinetics.

When using mathematical models to make quantitative predictions for clinical or industrial use, it is important that predictions come with a reliable estimate of their accuracy (uncertainty quantification). Because models of complex biological systems are always large simplifications, model discrepancy arises-models fail to perfectly recapitulate the true data generating process. This presents a particular challenge for making accurate predictions, and especially for accurately quantifying uncertainty in these predictions. Experimentalists and modellers must choose which experimental procedures (protocols) are used to produce data used to train models. We propose to characterise uncertainty owing to model discrepancy with an ensemble of parameter sets, each of which results from training to data from a different protocol. The variability in predictions from this ensemble provides an empirical estimate of predictive uncertainty owing to model discrepancy, even for unseen protocols. We use the example of electrophysiology experiments that investigate the properties of hERG potassium channels. Here, 'information-rich' protocols allow mathematical models to be trained using numerous short experiments performed on the same cell. In this case, we simulate data with one model and fit it with a different (discrepant) one. For any individual experimental protocol, parameter estimates vary little under repeated samples from the assumed additive independent Gaussian noise model. Yet parameter sets arising from the same model applied to different experiments conflict-highlighting model discrepancy. Our methods will help select more suitable ion channel models for future studies, and will be widely applicable to a range of biological modelling problems.

Ion channel model reduction using manifold boundaries.

Mathematical models of voltage-gated ion channels are used in basic research, industrial and clinical settings. These models range in complexity, but typically contain numerous variables representing the proportion of channels in a given state, and parameters describing the voltage-dependent rates of transition between states. An open problem is selecting the appropriate degree of complexity and structure for an ion channel model given data availability. Here, we simplify a model of the cardiac human Ether-à-go-go related gene (hERG) potassium ion channel, which carries cardiac IKr, using the manifold boundary approximation method (MBAM). The MBAM approximates high-dimensional model-output manifolds by reduced models describing their boundaries, resulting in models with fewer parameters (and often variables). We produced a series of models of reducing complexity starting from an established five-state hERG model with 15 parameters. Models with up to three fewer states and eight fewer parameters were shown to retain much of the predictive capability of the full model and were validated using experimental hERG1a data collected in HEK293 cells at 37°C. The method provides a way to simplify complex models of ion channels that improves parameter identifiability and will aid in future model development.

A Parameter Representing Missing Charge Should Be Considered when Calibrating Action Potential Models.

Computational models of the electrical potential across a cell membrane are longstanding and vital tools in electrophysiology research and applications. These models describe how ionic currents, internal fluxes, and buffering interact to determine membrane voltage and form action potentials (APs). Although this relationship is usually expressed as a differential equation, previous studies have shown it can be rewritten in an algebraic form, allowing direct calculation of membrane voltage. Rewriting in this form requires the introduction of a new parameter, called Γ0 in this manuscript, which represents the net concentration of all charges that influence membrane voltage but are not considered in the model. Although several studies have examined the impact of Γ0 on long-term stability and drift in model predictions, there has been little examination of its effects on model predictions, particularly when a model is refit to new data. In this study, we illustrate how Γ0 affects important physiological properties such as action potential duration restitution, and examine the effects of (in)correctly specifying Γ0 during model calibration. We show that, although physiologically plausible, the range of concentrations used in popular models leads to orders of magnitude differences in Γ0, which can lead to very different model predictions. In model calibration, we find that using an incorrect value of Γ0 can lead to biased estimates of the inferred parameters, but that the predictive power of these models can be restored by fitting Γ0 as a separate parameter. These results show the value of making Γ0 explicit in model formulations, as it forces modellers and experimenters to consider the effects of uncertainty and potential discrepancy in initial concentrations upon model predictions.