Systems Biology of Metabolism.

Metabolism is highly complex and involves thousands of different connected reactions; it is therefore necessary to use mathematical models for holistic studies. The use of mathematical models in biology is referred to as systems biology. In this review, the principles of systems biology are described, and two different types of mathematical models used for studying metabolism are discussed: kinetic models and genome-scale metabolic models. The use of different omics technologies, including transcriptomics, proteomics, metabolomics, and fluxomics, for studying metabolism is presented. Finally, the application of systems biology for analyzing global regulatory structures, engineering the metabolism of cell factories, and analyzing human diseases is discussed.

Enter the Matrix: Factorization Uncovers Knowledge from Omics.

Omics data contain signals from the molecular, physical, and kinetic inter- and intracellular interactions that control biological systems. Matrix factorization (MF) techniques can reveal low-dimensional structure from high-dimensional data that reflect these interactions. These techniques can uncover new biological knowledge from diverse high-throughput omics data in applications ranging from pathway discovery to timecourse analysis. We review exemplary applications of MF for systems-level analyses. We discuss appropriate applications of these methods, their limitations, and focus on the analysis of results to facilitate optimal biological interpretation. The inference of biologically relevant features with MF enables discovery from high-throughput data beyond the limits of current biological knowledge - answering questions from high-dimensional data that we have not yet thought to ask.

Conceptual and computational framework for logical modelling of biological networks deregulated in diseases.

Mathematical models can serve as a tool to formalize biological knowledge from diverse sources, to investigate biological questions in a formal way, to test experimental hypotheses, to predict the effect of perturbations and to identify underlying mechanisms. We present a pipeline of computational tools that performs a series of analyses to explore a logical model's properties. A logical model of initiation of the metastatic process in cancer is used as a transversal example. We start by analysing the structure of the interaction network constructed from the literature or existing databases. Next, we show how to translate this network into a mathematical object, specifically a logical model, and how robustness analyses can be applied to it. We explore the visualization of the stable states, defined as specific attractors of the model, and match them to cellular fates or biological read-outs. With the different tools we present here, we explain how to assign to each solution of the model a probability and how to identify genetic interactions using mutant phenotype probabilities. Finally, we connect the model to relevant experimental data: we present how some data analyses can direct the construction of the network, and how the solutions of a mathematical model can also be compared with experimental data, with a particular focus on high-throughput data in cancer biology. A step-by-step tutorial is provided as a Supplementary Material and all models, tools and scripts are provided on an accompanying website: https://github.com/sysbio-curie/Logical_modelling_pipeline.

FAMoS: A Flexible and dynamic Algorithm for Model Selection to analyse complex systems dynamics.

Most biological systems are difficult to analyse due to a multitude of interacting components and the concomitant lack of information about the essential dynamics. Finding appropriate models that provide a systematic description of such biological systems and that help to identify their relevant factors and processes can be challenging given the sheer number of possibilities. Model selection algorithms that evaluate the performance of a multitude of different models against experimental data provide a useful tool to identify appropriate model structures. However, many algorithms addressing the analysis of complex dynamical systems, as they are often used in biology, compare a preselected number of models or rely on exhaustive searches of the total model space which might be unfeasible dependent on the number of possibilities. Therefore, we developed an algorithm that is able to perform model selection on complex systems and searches large model spaces in a dynamical way. Our algorithm includes local and newly developed non-local search methods that can prevent the algorithm from ending up in local minima of the model space by accounting for structurally similar processes. We tested and validated the algorithm based on simulated data and showed its flexibility for handling different model structures. We also used the algorithm to analyse experimental data on the cell proliferation dynamics of CD4+ and CD8+ T cells that were cultured under different conditions. Our analyses indicated dynamical changes within the proliferation potential of cells that was reduced within tissue-like 3D ex vivo cultures compared to suspension. Due to the flexibility in handling various model structures, the algorithm is applicable to a large variety of different biological problems and represents a useful tool for the data-oriented evaluation of complex model spaces.

Fast uncertainty quantification for dynamic flux balance analysis using non-smooth polynomial chaos expansions.

We present a novel surrogate modeling method that can be used to accelerate the solution of uncertainty quantification (UQ) problems arising in nonlinear and non-smooth models of biological systems. In particular, we focus on dynamic flux balance analysis (DFBA) models that couple intracellular fluxes, found from the solution of a constrained metabolic network model of the cellular metabolism, to the time-varying nature of the extracellular substrate and product concentrations. DFBA models are generally computationally expensive and present unique challenges to UQ, as they entail dynamic simulations with discrete events that correspond to switches in the active set of the solution of the constrained intracellular model. The proposed non-smooth polynomial chaos expansion (nsPCE) method is an extension of traditional PCE that can effectively capture singularities in the DFBA model response due to the occurrence of these discrete events. The key idea in nsPCE is to use a model of the singularity time to partition the parameter space into two elements on which the model response behaves smoothly. Separate PCE models are then fit in both elements using a basis-adaptive sparse regression approach that is known to scale well with respect to the number of uncertain parameters. We demonstrate the effectiveness of nsPCE on a DFBA model of an E. coli monoculture that consists of 1075 reactions and 761 metabolites. We first illustrate how traditional PCE is unable to handle problems of this level of complexity. We demonstrate that over 800-fold savings in computational cost of uncertainty propagation and Bayesian estimation of parameters in the substrate uptake kinetics can be achieved by using the nsPCE surrogates in place of the full DFBA model simulations. We then investigate the scalability of the nsPCE method by utilizing it for global sensitivity analysis and maximum a posteriori estimation in a synthetic metabolic network problem with a larger number of parameters related to both intracellular and extracellular quantities.

Time-dependent product-form Poisson distributions for reaction networks with higher order complexes.

It is well known that stochastically modeled reaction networks that are complex balanced admit a stationary distribution that is a product of Poisson distributions. In this paper, we consider the following related question: supposing that the initial distribution of a stochastically modeled reaction network is a product of Poissons, under what conditions will the distribution remain a product of Poissons for all time? By drawing inspiration from Crispin Gardiner's "Poisson representation" for the solution to the chemical master equation, we provide a necessary and sufficient condition for such a product-form distribution to hold for all time. Interestingly, the condition is a dynamical "complex-balancing" for only those complexes that have multiplicity greater than or equal to two (i.e. the higher order complexes that yield non-linear terms to the dynamics). We term this new condition the "dynamical and restricted complex balance" condition (DR for short).

Black-boxing and cause-effect power.

Reductionism assumes that causation in the physical world occurs at the micro level, excluding the emergence of macro-level causation. We challenge this reductionist assumption by employing a principled, well-defined measure of intrinsic cause-effect power-integrated information (Φ), and showing that, according to this measure, it is possible for a macro level to "beat" the micro level. Simple systems were evaluated for Φ across different spatial and temporal scales by systematically considering all possible black boxes. These are macro elements that consist of one or more micro elements over one or more micro updates. Cause-effect power was evaluated based on the inputs and outputs of the black boxes, ignoring the internal micro elements that support their input-output function. We show how black-box elements can have more common inputs and outputs than the corresponding micro elements, revealing the emergence of high-order mechanisms and joint constraints that are not apparent at the micro level. As a consequence, a macro, black-box system can have higher Φ than its micro constituents by having more mechanisms (higher composition) that are more interconnected (higher integration). We also show that, for a given micro system, one can identify local maxima of Φ across several spatiotemporal scales. The framework is demonstrated on a simple biological system, the Boolean network model of the fission-yeast cell-cycle, for which we identify stable local maxima during the course of its simulated biological function. These local maxima correspond to macro levels of organization at which emergent cause-effect properties of physical systems come into focus, and provide a natural vantage point for scientific inquiries.

Bayesian inference of hub nodes across multiple networks.

Hub nodes within biological networks play a pivotal role in determining phenotypes and disease outcomes. In the multiple network setting, we are interested in understanding network similarities and differences across different experimental conditions or subtypes of disease. The majority of proposed approaches for joint modeling of multiple networks focus on the sharing of edges across graphs. Rather than assuming the network similarities are driven by individual edges, we instead focus on the presence of common hub nodes, which are more likely to be preserved across settings. Specifically, we formulate a Bayesian approach to the problem of multiple network inference which allows direct inference on shared and differential hub nodes. The proposed method not only allows a more intuitive interpretation of the resulting networks and clearer guidance on potential targets for treatment, but also improves power for identifying the edges of highly connected nodes. Through simulations, we demonstrate the utility of our method and compare its performance to current popular methods that do not borrow information regarding hub nodes across networks. We illustrate the applicability of our method to inference of co-expression networks from The Cancer Genome Atlas ovarian carcinoma dataset.

Asymptotic State of a Two-Patch System with Infinite Diffusion.

Mathematical theory has predicted that populations diffusing in heterogeneous environments can reach larger total size than when not diffusing. This prediction was tested in a recent experiment, which leads to extension of the previous theory to consumer-resource systems with external resource input. This paper studies a two-patch model with diffusion that characterizes the experiment. Solutions of the model are shown to be nonnegative and bounded, and global dynamics of the subsystems are completely exhibited. It is shown that there exist stable positive equilibria as the diffusion rate is large, and the equilibria converge to a unique positive point as the diffusion tends to infinity. Rigorous analysis on the model demonstrates that homogeneously distributed resources support larger carrying capacity than heterogeneously distributed resources with or without diffusion, which coincides with experimental observations but refutes previous theory. It is shown that spatial diffusion increases total equilibrium population abundance in heterogeneous environments, which coincides with real data and previous theory while a new insight is exhibited. A novel prediction of this work is that these results hold even with source-sink populations and increasing diffusion rate of consumer could change its persistence to extinction in the same-resource environments.

Variability of Betweenness Centrality and Its Effect on Identifying Essential Genes.

This paper begins to build a theoretical framework that would enable the pharmaceutical industry to use network complexity measures as a way to identify drug targets. The variability of a betweenness measure for a network node is examined through different methods of network perturbation. Our results indicate a robustness of betweenness centrality in the identification of target genes.

Prioritizing disease-causing microbes based on random walking on the heterogeneous network.

As we all know, the microbiota show remarkable variability within individuals. At the same time, those microorganisms living in the human body play a very important role in our health and disease, so the identification of the relationships between microbes and diseases will contribute to better understanding of microbes interactions, mechanism of functions. However, the microbial data which are obtained through the related technical sequencing is too much, but the known associations between the diseases and microbes are very less. In bioinformatics, many researchers choose the network topology analysis to solve these problems. Inspired by this idea, we proposed a new method for prioritization of candidate microbes to predict potential disease-microbe association. First of all, we connected the disease network and microbe network based on the known disease-microbe relationships information to construct a heterogeneous network, then we extended the random walk to the heterogeneous network, and used leave-one-out cross-validation and ROC curve to evaluate the method. In conclusion, the algorithm could be effective to disclose some potential associations between diseases and microbes that cannot be found by microbe network or disease network only. Furthermore, we studied three representative diseases, Type 2 diabetes, Asthma and Psoriasis, and finally presented the potential microbes associated with these diseases by ranking candidate disease-causing microbes, respectively. We confirmed that the discovery of the new associations will be a good clinical solution for disease mechanism understanding, diagnosis and therapy.

The Crisis of Reproducibility, the Denominator Problem and the Scientific Role of Multi-scale Modeling.

The "Crisis of Reproducibility" has received considerable attention both within the scientific community and without. While factors associated with scientific culture and practical practice are most often invoked, I propose that the Crisis of Reproducibility is ultimately a failure of generalization with a fundamental scientific basis in the methods used for biomedical research. The Denominator Problem describes how limitations intrinsic to the two primary approaches of biomedical research, clinical studies and preclinical experimental biology, lead to an inability to effectively characterize the full extent of biological heterogeneity, which compromises the task of generalizing acquired knowledge. Drawing on the example of the unifying role of theory in the physical sciences, I propose that multi-scale mathematical and dynamic computational models, when mapped to the modular structure of biological systems, can serve a unifying role as formal representations of what is conserved and similar from one biological context to another. This ability to explicitly describe the generation of heterogeneity from similarity addresses the Denominator Problem and provides a scientific response to the Crisis of Reproducibility.

Exact probabilities for the indeterminacy of complex networks as perceived through press perturbations.

We consider the goal of predicting how complex networks respond to chronic (press) perturbations when characterizations of their network topology and interaction strengths are associated with uncertainty. Our primary result is the derivation of exact formulas for the expected number and probability of qualitatively incorrect predictions about a system's responses under uncertainties drawn form arbitrary distributions of error. Additional indices provide new tools for identifying which links in a network are most qualitatively and quantitatively sensitive to error, and for determining the volume of errors within which predictions will remain qualitatively determinate (i.e. sign insensitive). Together with recent advances in the empirical characterization of uncertainty in networks, these tools bridge a way towards probabilistic predictions of network dynamics.

Greater accuracy and broadened applicability of phase reduction using isostable coordinates.

The applicability of phase models is generally limited by the constraint that the dynamics of a perturbed oscillator must stay near its underlying periodic orbit. Consequently, external perturbations must be sufficiently weak so that these assumptions remain valid. Using the notion of isostables of periodic orbits to provide a simplified coordinate system from which to understand the dynamics transverse to a periodic orbit, we devise a strategy to correct for changing phase dynamics for locations away from the limit cycle. Consequently, these corrected phase dynamics allow for perturbations of larger magnitude without invalidating the underlying assumptions of the reduction. The proposed reduction strategy yields a closed set of equations and can be applied to periodic orbits embedded in arbitrarily high dimensional spaces. We illustrate the utility of this strategy in two models with biological relevance. In the first application, we find that an optimal control strategy for modifying the period of oscillation can be improved with the corrected phase reduction. In the second, the corrected phase reduced dynamics are used to understand adaptation and memory effects resulting from past perturbations.

Integration of multi-omics data of a genome-reduced bacterium: Prevalence of post-transcriptional regulation and its correlation with protein abundances.

We developed a comprehensive resource for the genome-reduced bacterium Mycoplasma pneumoniae comprising 1748 consistently generated '-omics' data sets, and used it to quantify the power of antisense non-coding RNAs (ncRNAs), lysine acetylation, and protein phosphorylation in predicting protein abundance (11%, 24% and 8%, respectively). These factors taken together are four times more predictive of the proteome abundance than of mRNA abundance. In bacteria, post-translational modifications (PTMs) and ncRNA transcription were both found to increase with decreasing genomic GC-content and genome size. Thus, the evolutionary forces constraining genome size and GC-content modify the relative contributions of the different regulatory layers to proteome homeostasis, and impact more genomic and genetic features than previously appreciated. Indeed, these scaling principles will enable us to develop more informed approaches when engineering minimal synthetic genomes.

Scaling for Dynamical Systems in Biology.

Asymptotic methods can greatly simplify the analysis of all but the simplest mathematical models and should therefore be commonplace in such biological areas as ecology and epidemiology. One essential difficulty that limits their use is that they can only be applied to a suitably scaled dimensionless version of the original dimensional model. Many books discuss nondimensionalization, but with little attention given to the problem of choosing the right scales and dimensionless parameters. In this paper, we illustrate the value of using asymptotics on a properly scaled dimensionless model, develop a set of guidelines that can be used to make good scaling choices, and offer advice for teaching these topics in differential equations or mathematical biology courses.

Data management strategies for multinational large-scale systems biology projects.

Good accessibility of publicly funded research data is essential to secure an open scientific system and eventually becomes mandatory [Wellcome Trust will Penalise Scientists Who Don't Embrace Open Access. The Guardian 2012]. By the use of high-throughput methods in many research areas from physics to systems biology, large data collections are increasingly important as raw material for research. Here, we present strategies worked out by international and national institutions targeting open access to publicly funded research data via incentives or obligations to share data. Funding organizations such as the British Wellcome Trust therefore have developed data sharing policies and request commitment to data management and sharing in grant applications. Increased citation rates are a profound argument for sharing publication data. Pre-publication sharing might be rewarded by a data citation credit system via digital object identifiers (DOIs) which have initially been in use for data objects. Besides policies and incentives, good practice in data management is indispensable. However, appropriate systems for data management of large-scale projects for example in systems biology are hard to find. Here, we give an overview of a selection of open-source data management systems proved to be employed successfully in large-scale projects.

Algebraic Systems Biology: A Case Study for the Wnt Pathway.

Steady-state analysis of dynamical systems for biological networks gives rise to algebraic varieties in high-dimensional spaces whose study is of interest in their own right. We demonstrate this for the shuttle model of the Wnt signaling pathway. Here, the variety is described by a polynomial system in 19 unknowns and 36 parameters. It has degree 9 over the parameter space. This case study explores multistationarity, model comparison, dynamics within regions of the state space, identifiability, and parameter estimation, from a geometric point of view. We employ current methods from computational algebraic geometry, polyhedral geometry, and combinatorics.

Convergence Properties of Posttranslationally Modified Protein-Protein Switching Networks with Fast Decay Rates.

A significant conceptual difficulty in the use of switching systems to model regulatory networks is the presence of so-called "black walls," co-dimension 1 regions of phase space with a vector field pointing inward on both sides of the hyperplane. Black walls result from the existence of direct negative self-regulation in the system. One biologically inspired way of removing black walls is the introduction of intermediate variables that mediate the negative self-regulation. In this paper, we study such a perturbation. We replace a switching system with a higher-dimensional switching system with rapidly decaying intermediate proteins, and compare the dynamics between the two systems. We find that the while the individual solutions of the original system can be approximated for a finite time by solutions of a sufficiently close perturbed system, there are always solutions that are not well approximated for any fixed perturbation. We also study a particular example, where global basins of attraction of the perturbed system have a strikingly different form than those of the original system. We perform this analysis using techniques that are adapted to dealing with non-smooth systems.

Network-Based Biomedical Data Analysis.

Complex diseases are caused by disorders of both internal and external factors, and they account for a large proportion of human diseases. They are multigenetic and rarely a consequence of the dysfunction of single molecules. Systems biology views the living organism as an organic network. Compared with reductionism-based viewpoints, systems biology pays more attention to the interactions among molecules located at different omics levels. Based on this theory, the concepts of network biomarkers and network medicine have been proposed sequentially, which integrate clinical data with knowledge of network sciences, thereby promoting the investigation of disease pathogenesis in the era of biomedical informatics. The former aims to identify precise signals for disease diagnosis and prognosis, whereas the latter focuses on developing effective therapeutic strategies for specific patient cohorts. In this chapter, the basic concepts of systems biology and network theory are presented, and clinical applications of biomolecular networks, network biomarkers, and network medicine are then discussed.