First-order ultrasensitivity in phosphorylation cycles.

Cellular signal transduction takes place through a network of phosphorylation cycles. These pathways take the form of a multi-layered cascade of cycles. This work focuses on the sensitivity of single, double and n length cycles. Cycles that operate in the zero-order regime can become sensitive to changes in signal, resulting in zero-order ultrasensitivity (ZOU). Using frequency analysis, we confirm previous efforts that cascades can act as noise filters by computing the bandwidth. We show that n length cycles display what we term first-order ultrasensitivity which occurs even when the cycles are not operating in the zero-order regime. The magnitude of the sensitivity, however, has an upper bound equal to the number of cycles. It is known that ZOU can be significantly reduced in the presence of retroactivity. We show that the first-order ultrasensitivity is immune to retroactivity and that the ZOU and first-order ultrasensitivity can be blended to create systems with constant sensitivity over a wider range of signal. We show that the ZOU in a double cycle is only modestly higher compared with a single cycle. We therefore speculate that the double cycle has evolved to enable amplification even in the face of retroactivity.

VSCode-Antimony: a source editor for building, analyzing, and translating antimony models.

MOTIVATION: Developing biochemical models in systems biology is a complex, knowledge-intensive activity. Some modelers (especially novices) benefit from model development tools with a graphical user interface. However, as with the development of complex software, text-based representations of models provide many benefits for advanced model development. At present, the tools for text-based model development are limited, typically just a textual editor that provides features such as copy, paste, find, and replace. Since these tools are not "model aware," they do not provide features for: (i) model building such as autocompletion of species names; (ii) model analysis such as hover messages that provide information about chemical species; and (iii) model translation to convert between model representations. We refer to these as BAT features. RESULTS: We present VSCode-Antimony, a tool for building, analyzing, and translating models written in the Antimony modeling language, a human readable representation of Systems Biology Markup Language (SBML) models. VSCode-Antimony is a source editor, a tool with language-aware features. For example, there is autocompletion of variable names to assist with model building, hover messages that aid in model analysis, and translation between XML and Antimony representations of SBML models. These features result from making VSCode-Antimony model-aware by incorporating several sophisticated capabilities: analysis of the Antimony grammar (e.g. to identify model symbols and their types); a query system for accessing knowledge sources for chemical species and reactions; and automatic conversion between different model representations (e.g. between Antimony and SBML). AVAILABILITY AND IMPLEMENTATION: VSCode-Antimony is available as an open source extension in the VSCode Marketplace https://marketplace.visualstudio.com/items?itemName=stevem.vscode-antimony. Source code can be found at https://github.com/sys-bio/vscode-antimony.

Sensitivity and Frequency Response of Biochemical Cascades.

Signal transduction from a cell's surface to cytoplasmic and nuclear targets takes place through a complex network of interconnected pathways. Phosphorylation cycles are common components of many pathways and may take the form of a multi-layered cascade of cycles or incorporate species with multiple phosphorylation sites that effectively create a sequence of cycles with increasing states of phosphorylation. This work focuses on the frequency response and sensitivity of such systems, two properties that have not been thoroughly examined. Starting with a singularly phosphorylated single-cycle system, we compare the sensitivity to perturbation at steady-state across a range of input signal strengths. This is followed by a frequency response analysis focusing on the gain and associated bandwidth. Next, we consider a two-layer cascade of single phosphorylation cycles and focus on how the two cycles interact to produce various effects on the bandwidth and damping properties. Then we consider the (ultra)sensitivity of a doubly phosphorylated system, where we describe in detail first-order ultrasensitivity, a unique property of these systems, which can be blended with zero-order ultrasensitivity to create systems with relatively constant gain over a range of signal input. Finally, we give an in-depth analysis of the sensitivity of an n-phosphorylated system.

An automated model annotation system (AMAS) for SBML models.

MOTIVATION: Annotations of biochemical models provide details of chemical species, documentation of chemical reactions, and other essential information. Unfortunately, the vast majority of biochemical models have few, if any, annotations, or the annotations provide insufficient detail to understand the limitations of the model. The quality and quantity of annotations can be improved by developing tools that recommend annotations. For example, recommender tools have been developed for annotations of genes. Although annotating genes is conceptually similar to annotating biochemical models, there are important technical differences that make it difficult to directly apply this prior work. RESULTS: We present AMAS, a system that predicts annotations for elements of models represented in the Systems Biology Markup Language (SBML) community standard. We provide a general framework for predicting model annotations for a query element based on a database of annotated reference elements and a match score function that calculates the similarity between the query element and reference elements. The framework is instantiated to specific element types (e.g. species, reactions) by specifying the reference database (e.g. ChEBI for species) and the match score function (e.g. string similarity). We analyze the computational efficiency and prediction quality of AMAS for species and reactions in BiGG and BioModels and find that it has subsecond response times and accuracy between 80% and 95% depending on specifics of what is predicted. We have incorporated AMAS into an open-source, pip-installable Python package that can run as a command-line tool that predicts and adds annotations to species and reactions to an SBML model. AVAILABILITY AND IMPLEMENTATION: Our project is hosted at https://github.com/sys-bio/AMAS, where we provide examples, documentation, and source code files. Our source code is licensed under the MIT open-source license.

An Automated Model Annotation System (AMAS) for SBML Models.

Motivation: Annotations of biochemical models provide details of chemical species, documentation of chemical reactions, and other essential information. Unfortunately, the vast majority of biochemical models have few, if any, annotations, or the annotations provide insufficient detail to understand the limitations of the model. The quality and quantity of annotations can be improved by developing tools that recommend annotations. For example, recommender tools have been developed for annotations of genes. Although annotating genes is conceptually similar to annotating biochemical models, there are important technical differences that make it difficult to directly apply this prior work. Results: We present AMAS, a system that predicts annotations for elements of models represented in the Systems Biology Markup Language (SBML) community standard. We provide a general framework for predicting model annotations for a query element based on a database of annotated reference elements and a match score function that calculates the similarity between the query element and reference elements. The framework is instantiated to specific element types (e.g., species, reactions) by specifying the reference database (e.g., ChEBI for species) and the match score function (e.g., string similarity). We analyze the computational efficiency and prediction quality of AMAS for species and reactions in BiGG and BioModels and find that it has sub-second response times and accuracy between 80% and 95% depending on specifics of what is predicted. We have incorporated AMAS into an open-source, pip-installable Python package that can run as a command-line tool that predicts and adds annotations to species and reactions to an SBML model. Availability: Our project is hosted at https://github.com/sys-bio/AMAS, where we provide examples, documentation, and source code files. Our source code is licensed under the MIT open-source license.

Adapting modeling and simulation credibility standards to computational systems biology.

Computational models are increasingly used in high-impact decision making in science, engineering, and medicine. The National Aeronautics and Space Administration (NASA) uses computational models to perform complex experiments that are otherwise prohibitively expensive or require a microgravity environment. Similarly, the Food and Drug Administration (FDA) and European Medicines Agency (EMA) have began accepting models and simulations as forms of evidence for pharmaceutical and medical device approval. It is crucial that computational models meet a standard of credibility when using them in high-stakes decision making. For this reason, institutes including NASA, the FDA, and the EMA have developed standards to promote and assess the credibility of computational models and simulations. However, due to the breadth of models these institutes assess, these credibility standards are mostly qualitative and avoid making specific recommendations. On the other hand, modeling and simulation in systems biology is a narrower domain and several standards are already in place. As systems biology models increase in complexity and influence, the development of a credibility assessment system is crucial. Here we review existing standards in systems biology, credibility standards in other science, engineering, and medical fields, and propose the development of a credibility standard for systems biology models.

Cesium: A public database of evolved oscillatory reaction networks.

New tools and software in systems biology require testing and validation on reaction networks with desired characteristics such as number of reactions or oscillating behaviors. Often, there is only a modest number of published models that are suitable, so researchers must generate reaction networks with the desired characteristics, a process that can be computationally expensive. To reduce these computational costs, we developed a data base of synthetic reaction networks to facilitate reuse. The current database contains thousands of networks generated using directed evolution. The network are of two types: (1) those with oscillations in species concentrations and (2) those for which no oscillation was found using directed evolution. To facilitate access to networks of interest, the database is queryable by the number of species and reactants, the presence or absence of autocatalytic and degradation reactions, and the network behavior. Our analysis of the data revealed some interesting insights, such as the population of oscillating networks possess more autocatalytic reactions compared to random control networks. In the future, this database will be expanded to include other network behaviors.

BioSimulators: a central registry of simulation engines and services for recommending specific tools.

Computational models have great potential to accelerate bioscience, bioengineering, and medicine. However, it remains challenging to reproduce and reuse simulations, in part, because the numerous formats and methods for simulating various subsystems and scales remain siloed by different software tools. For example, each tool must be executed through a distinct interface. To help investigators find and use simulation tools, we developed BioSimulators (https://biosimulators.org), a central registry of the capabilities of simulation tools and consistent Python, command-line and containerized interfaces to each version of each tool. The foundation of BioSimulators is standards, such as CellML, SBML, SED-ML and the COMBINE archive format, and validation tools for simulation projects and simulation tools that ensure these standards are used consistently. To help modelers find tools for particular projects, we have also used the registry to develop recommendation services. We anticipate that BioSimulators will help modelers exchange, reproduce, and combine simulations.

Isolating structural errors in reaction networks in systems biology.

MOTIVATION: The growing complexity of reaction-based models necessitates early detection and resolution of model errors. Considerable work has been done on the detection of mass balance errors, especially atomic mass analysis (AMA) (which compares the counts of atoms in the reactants and products) and Linear Programming analysis (which detects stoichiometric inconsistencies). This article extends model error checking to include: (i) certain structural errors in reaction networks and (ii) error isolation. First, we consider the balance of chemical structures (moieties) between reactants and products. This balance is expected in many biochemical reactions, but the imbalance of chemical structures cannot be detected if the analysis is done in units of atomic masses. Second, we improve on error isolation for stoichiometric inconsistencies by identifying a small number of reactions and/or species that cause the error. Doing so simplifies error remediation. RESULTS: We propose two algorithms that address isolating structural errors in reaction networks. Moiety analysis finds imbalances of moieties using the same algorithm as AMA, but moiety analysis works in units of moieties instead of atomic masses. We argue for the value of checking moiety balance, and discuss two approaches to decomposing chemical species into moieties. Graphical Analysis of Mass Equivalence Sets (GAMES) provides isolation for stoichiometric inconsistencies by constructing explanations that relate errors in the structure of the reaction network to elements of the reaction network. We study the effectiveness of moiety analysis and GAMES on curated models in the BioModels repository. We have created open source codes for moiety analysis and GAMES. AVAILABILITY AND IMPLEMENTATION: Our project is hosted at https://github.com/ModelEngineering/SBMLLint, which contains examples, documentation, source code files and build scripts used to create SBMLLint. Our source code is licensed under the MIT open source license. SUPPLEMENTARY INFORMATION: Supplementary data are available at Bioinformatics online.

Recent advances in biomedical simulations: a manifesto for model engineering.

Biomedical simulations are widely used to understand disease, engineer cells, and model cellular processes. In this article, we explore how to improve the quality of biomedical simulations by developing simulation models using tools and practices employed in software engineering. We refer to this direction as model engineering. Not all techniques used by software engineers are directly applicable to model engineering, and so some adaptations are required. That said, we believe that simulation models can benefit from software engineering practices for requirements, design, and construction as well as from software engineering tools for version control, error checking, and testing. Here we survey current efforts to improve simulation quality and discuss promising research directions for model engineering.