deepHPI: a comprehensive deep learning platform for accurate prediction and visualization of host-pathogen protein-protein interactions.

Host-pathogen protein interactions (HPPIs) play vital roles in many biological processes and are directly involved in infectious diseases. With the outbreak of more frequent pandemics in the last couple of decades, such as the recent outburst of Covid-19 causing millions of deaths, it has become more critical to develop advanced methods to accurately predict pathogen interactions with their respective hosts. During the last decade, experimental methods to identify HPIs have been used to decipher host-pathogen systems with the caveat that those techniques are labor-intensive, expensive and time-consuming. Alternatively, accurate prediction of HPIs can be performed by the use of data-driven machine learning. To provide a more robust and accurate solution for the HPI prediction problem, we have developed a deepHPI tool based on deep learning. The web server delivers four host-pathogen model types: plant-pathogen, human-bacteria, human-virus and animal-pathogen, leveraging its operability to a wide range of analyses and cases of use. The deepHPI web tool is the first to use convolutional neural network models for HPI prediction. These models have been selected based on a comprehensive evaluation of protein features and neural network architectures. The best prediction models have been tested on independent validation datasets, which achieved an overall Matthews correlation coefficient value of 0.87 for animal-pathogen using the combined pseudo-amino acid composition and conjoint triad (PAAC_CT) features, 0.75 for human-bacteria using the combined pseudo-amino acid composition, conjoint triad and normalized Moreau-Broto feature (PAAC_CT_NMBroto), 0.96 for human-virus using PAAC_CT_NMBroto and 0.94 values for plant-pathogen interactions using the combined pseudo-amino acid composition, composition and transition feature (PAAC_CTDC_CTDT). Our server running deepHPI is deployed on a high-performance computing cluster that enables large and multiple user requests, and it provides more information about interactions discovered. It presents an enriched visualization of the resulting host-pathogen networks that is augmented with external links to various protein annotation resources. We believe that the deepHPI web server will be very useful to researchers, particularly those working on infectious diseases. Additionally, many novel and known host-pathogen systems can be further investigated to significantly advance our understanding of complex disease-causing agents. The developed models are established on a web server, which is freely accessible at http://bioinfo.usu.edu/deepHPI/.

Deep reinforcement learning stock market trading, utilizing a CNN with candlestick images.

Billions of dollars are traded automatically in the stock market every day, including algorithms that use neural networks, but there are still questions regarding how neural networks trade. The black box nature of a neural network gives pause to entrusting it with valuable trading funds. A more recent technique for the study of neural networks, feature map visualizations, yields insight into how a neural network generates an output. Utilizing a Convolutional Neural Network (CNN) with candlestick images as input and feature map visualizations gives a unique opportunity to determine what in the input images is causing the neural network to output a certain action. In this study, a CNN is utilized within a Double Deep Q-Network (DDQN) to outperform the S&P 500 Index returns, and also analyze how the system trades. The DDQN is trained and tested on the 30 largest stocks in the S&P 500. Following training the CNN is used to generate feature map visualizations to determine where the neural network is placing its attention on the candlestick images. Results show that the DDQN is able to yield higher returns than the S&P 500 Index between January 2, 2020 and June 30, 2020. Results also show that the CNN is able to switch its attention from all the candles in a candlestick image to the more recent candles in the image, based on an event such as the coronavirus stock market crash of 2020.

Transport-based pattern recognition versus deep neural networks in underwater OAM communications.

Comparisons between machine learning and optimal transport-based approaches in classifying images are made in underwater orbital angular momentum (OAM) communications. A model is derived that justifies optimal transport for use in attenuated water environments. OAM pattern demultiplexing is performed using optimal transport and deep neural networks and compared to each other. Additionally, some of the complications introduced by signal attenuation are highlighted. The Radon cumulative distribution transform (R-CDT) is applied to OAM patterns to transform them to a linear subspace. The original OAM images and the R-CDT transformed patterns are used in several classification algorithms, and results are compared. The selected classification algorithms are the nearest subspace algorithm, a shallow convolutional neural network (CNN), and a deep neural network. It is shown that the R-CDT transformed images are more accurate than the original OAM images in pattern classification. Also, the nearest subspace algorithm performs better than the selected CNNs in OAM pattern classification in underwater environments.

A Model for Bioaugmented Anaerobic Granulation.

Anaerobic granular sludge comprises of highly organized microorganisms with a sophisticated metabolic network. Such aggregates can withstand storage, temperature fluctuations and changes in the substrate supplied for anaerobic digestion. However, substrate change leads to long adaptation of granular consortia, creating lags in the reactor operations. To speed up adaptation and increase digestion efficiency, bioaugmentation with a robust consortium can be performed. The computational study described here aims to elucidate the mechanisms of bioaugmenting anaerobic granules, utilizing the current body of knowledge on metabolic and biochemical interactions between bacteria in such aggregates. Using a cDynoMiCs simulation environment, an agent-based model was developed to describe bioaugmentation for adaptation of cellobiose-degrading granular consortium to a lipid-rich feed. Lipolytic bacteria were successfully incorporated in silico to the stable granular consortia after 40 days of simulation. The ratio of cellobiose and the lipid-derivative, oleate, in the feed played key role to ensure augmentation. At 0.5 g/L of both cellobiose and oleate in the feed, a homogeneous stable augmented consortium was formed and converted the given amount of substrate to 10.9 mg/L of methane as a final product of anaerobic digestion. The demonstrated model can be used as a planning tool for anaerobic digestion facilities considering transition of the inoculum to a new type of feed.

Data-driven multiscale modeling reveals the role of metabolic coupling for the spatio-temporal growth dynamics of yeast colonies.

BACKGROUND: Multicellular entities like mammalian tissues or microbial biofilms typically exhibit complex spatial arrangements that are adapted to their specific functions or environments. These structures result from intercellular signaling as well as from the interaction with the environment that allow cells of the same genotype to differentiate into well-organized communities of diversified cells. Despite its importance, our understanding how this cell-cell and metabolic coupling lead to functionally optimized structures is still limited. RESULTS: Here, we present a data-driven spatial framework to computationally investigate the development of yeast colonies as such a multicellular structure in dependence on metabolic capacity. For this purpose, we first developed and parameterized a dynamic cell state and growth model for yeast based on on experimental data from homogeneous liquid media conditions. The inferred model is subsequently used in a spatially coarse-grained model for colony development to investigate the effect of metabolic coupling by calibrating spatial parameters from experimental time-course data of colony growth using state-of-the-art statistical techniques for model uncertainty and parameter estimations. The model is finally validated by independent experimental data of an alternative yeast strain with distinct metabolic characteristics and illustrates the impact of metabolic coupling for structure formation. CONCLUSIONS: We introduce a novel model for yeast colony formation, present a statistical methodology for model calibration in a data-driven manner, and demonstrate how the established model can be used to generate predictions across scales by validation against independent measurements of genetically distinct yeast strains.

Cell death as a trigger for morphogenesis.

The complex morphologies observed in many biofilms play a critical role in the survival of these microbial communities. Recently, the formation of wrinkles has been the focus of many studies aimed at finding fundamental information on morphogenesis during development. While the underlying genetic mechanisms of wrinkling are not well-understood, recent discoveries have led to the counterintuitive idea that wrinkle formation is triggered by localized cell death. This work examines the hypothesis that the material properties of a biofilm both power and control wrinkle formation within biofilms in response to localized cell death. Using an agent-based model and a high-performance platform (Biocellion), we built a model that qualitatively reproduced wrinkle formation in biofilms due to cell death. Through the use of computational simulations, we determined important relationships between cellular level mechanical interactions and changes in colony morphology. These simulations were also used to identify significant cellular interactions that are required for wrinkle formation. These results are a first step towards more comprehensive models that, in combination with experimental observations, will improve our understanding of the morphological development of bacterial biofilms.

A computational study of VEGF production by patterned retinal epithelial cell colonies as a model for neovascular macular degeneration.

BACKGROUND: The configuration of necrotic areas within the retinal pigmented epithelium is an important element in the progression of age-related macular degeneration (AMD). In the exudative (wet) and non-exudative (dry) forms of the disease, retinal pigment epithelial (RPE) cells respond to adjacent atrophied regions by secreting vascular endothelial growth factor (VEGF) that in turn recruits new blood vessels which lead to a further reduction in retinal function and vision. In vitro models exist for studying VEGF expression in wet AMD (Vargis et al., Biomaterials 35(13):3999-4004, 2014), but are limited in the patterns of necrotic and intact RPE epithelium they can produce and in their ability to finely resolve VEGF expression dynamics. RESULTS: In this work, an in silico hybrid agent-based model was developed and validated using the results of this cell culture model of VEGF expression in AMD. The computational model was used to extend the cell culture investigation to explore the dynamics of VEGF expression in different sized patches of RPE cells and the role of negative feedback in VEGF expression. Results of the simulation and the cell culture studies were in excellent qualitative agreement, and close quantitative agreement. CONCLUSIONS: The model indicated that the configuration of necrotic and RPE cell-containing regions have a major impact on VEGF expression dynamics and made precise predictions of VEGF expression dynamics by groups of RPE cells of various sizes and configurations. Coupled with biological studies, this model may give insights into key molecular mechanisms of AMD progression and open routes to more effective treatments.

Modeling de novo granulation of anaerobic sludge.

BACKGROUND: A unique combination of mechanical, physiochemical and biological forces influences granulation during processes of anaerobic digestion. Understanding this process requires a systems biology approach due to the need to consider not just single-cell metabolic processes, but also the multicellular organization and development of the granule. RESULTS: In this computational experiment, we address the role that physiochemical and biological processes play in granulation and provide a literature-validated working model of anaerobic granule de novo formation. The agent-based model developed in a cDynoMiCs simulation environment successfully demonstrated a de novo granulation in a glucose fed system, with the average specific methanogenic activity of 1.11 ml C H 4/g biomass and formation of a 0.5 mm mature granule in 33 days. The simulated granules exhibit experimental observations of radial stratification: a central dead core surrounded by methanogens then encased in acidogens. Practical application of the granulation model was assessed on the anaerobic digestion of low-strength wastewater by measuring the changes in methane yield as experimental configuration parameters were systematically searched. CONCLUSIONS: In the model, the emergence of multicellular organization of anaerobic granules from randomly mixed population of methanogens and acidogens was observed and validated. The model of anaerobic de novo granulation can be used to predict the morphology of the anaerobic granules in a alternative substrates of interest and to estimate methane potential of the resulting microbial consortia. The study demonstrates a successful integration of a systems biology approach to model multicellular systems with the engineering of an efficient anaerobic digestion system.

Exploiting Self-organization in Bioengineered Systems: A Computational Approach.

The productivity of bioengineered cell factories is limited by inefficiencies in nutrient delivery and waste and product removal. Current solution approaches explore changes in the physical configurations of the bioreactors. This work investigates the possibilities of exploiting self-organizing vascular networks to support producer cells within the factory. A computational model simulates de novo vascular development of endothelial-like cells and the resultant network functioning to deliver nutrients and extract product and waste from the cell culture. Microbial factories with vascular networks are evaluated for their scalability, robustness, and productivity compared to the cell factories without a vascular network. Initial studies demonstrate that at least an order of magnitude increase in production is possible, the system can be scaled up, and the self-organization of an efficient vascular network is robust. The work suggests that bioengineered multicellularity may offer efficiency improvements difficult to achieve with physical engineering approaches.

Applying attractor dynamics to infer gene regulatory interactions involved in cellular differentiation.

The dynamics of gene regulatory networks (GRNs) guide cellular differentiation. Determining the ways regulatory genes control expression of their targets is essential to understand and control cellular differentiation. The way a regulatory gene controls its target can be expressed as a gene regulatory function. Manual derivation of these regulatory functions is slow, error-prone and difficult to update as new information arises. Automating this process is a significant challenge and the subject of intensive effort. This work presents a novel approach to discovering biologically plausible gene regulatory interactions that control cellular differentiation. This method integrates known cell type expression data, genetic interactions, and knowledge of the effects of gene knockouts to determine likely GRN regulatory functions. We employ a genetic algorithm to search for candidate GRNs that use a set of transcription factors that control differentiation within a lineage. Nested canalyzing functions are used to constrain the search space to biologically plausible networks. The method identifies an ensemble of GRNs whose dynamics reproduce the gene expression pattern for each cell type within a particular lineage. The method's effectiveness was tested by inferring consensus GRNs for myeloid and pancreatic cell differentiation and comparing the predicted gene regulatory interactions to manually derived interactions. We identified many regulatory interactions reported in the literature and also found differences from published reports. These discrepancies suggest areas for biological studies of myeloid and pancreatic differentiation. We also performed a study that used defined synthetic networks to evaluate the accuracy of the automated search method and found that the search algorithm was able to discover the regulatory interactions in these defined networks with high accuracy. We suggest that the GRN functions derived from the methods described here can be used to fill gaps in knowledge about regulatory interactions and to offer hypotheses for experimental testing of GRNs that control differentiation and other biological processes.

Modular genetic regulatory networks increase organization during pattern formation.

Studies have shown that genetic regulatory networks (GRNs) consist of modules that are densely connected subnetworks that function quasi-autonomously. Modules may be recognized motifs that comprise of two or three genes with particular regulatory functions and connectivity or be purely structural and identified through connection density. It is unclear what evolutionary and developmental advantages modular structure and in particular motifs provide that have led to this enrichment. This study seeks to understand how modules within developmental GRNs influence the complexity of multicellular patterns that emerge from the dynamics of the regulatory networks. We apply an algorithmic complexity to measure the organization of the patterns. A computational study was performed by creating Boolean intracellular networks within a simulated epithelial field of embryonic cells, where each cell contains the same network and communicates with adjacent cells using contact-mediated signaling. Intracellular networks with random connectivity were compared to those with modular connectivity and with motifs. Results show that modularity effects network dynamics and pattern organization significantly. In particular: (1) modular connectivity alone increases complexity in network dynamics and patterns; (2) bistable switch motifs simplify both the pattern and network dynamics; (3) all other motifs with feedback loops increase multicellular pattern complexity while simplifying the network dynamics; (4) negative feedback loops affect the dynamics complexity more significantly than positive feedback loops.

Genome-Wide Mapping of Chromatin State of Mouse Forelimbs.

BACKGROUND: Cell types are defined at the molecular level during embryogenesis by a process called pattern formation and created by the selective utilization of combinations of sequence specific transcription factors. Developmental programs define the sets of genes that are available to each particular cell type, and real-time biochemical signaling interactions define the extent to which these sets are used at any given time and place. Gene expression is regulated through the integrated action of many cis-regulatory elements, including core promoters, enhancers, silencers, and insulators. The chromatin state in developing body parts provides a code to cellular populations that direct their cell fates. Chromatin profiling has been a method of choice for mapping regulatory sequences in cells that go through developmental transitions. RESULTS: We used antibodies against histone H3 lysine 4 trimethylations (H3K4me3) a modification associated with promoters and open/active chromatin, histone H3 lysine 27 trimethylations (H3K27me3) associated with Polycomb-repressed regions and RNA polymerase II (Pol2) associated with transcriptional initiation to identify the chromatin state signature of the mouse forelimb during mid-gestation, at embryonic day 12 (E12). The families of genes marked included those related to transcriptional regulation and embryogenesis. One third of the marked genes were transcriptionally active while only a small fraction were bivalent marked. Sequence specific transcription factors that were activated were involved in cell specification including bone and muscle formation. CONCLUSION: Our results demonstrate that embryonic limb cells do not exhibit the plasticity of the ES cells but are rather programmed for a finer tuning for cell lineage specification.

Multistable switches and their role in cellular differentiation networks.

BACKGROUND: Cellular differentiation during development is controlled by gene regulatory networks (GRNs). This complex process is always subject to gene expression noise. There is evidence suggesting that commonly seen patterns in GRNs, referred to as biological multistable switches, play an important role in creating the structure of lineage trees by providing stability to cell types. RESULTS: To explore this question a new methodology is developed and applied to study (a) the multistable switch-containing GRN for hematopoiesis and (b) a large set of random boolean networks (RBNs) in which multistable switches were embedded systematically. In this work, each network attractor is taken to represent a distinct cell type. The GRNs were seeded with one or two identical copies of each multistable switch and the effect of these additions on two key aspects of network dynamics was assessed. These properties are the barrier to movement between pairs of attractors (separation) and the degree to which one direction of movement between attractor pairs is favored over another (directionality). Both of these properties are instrumental in shaping the structure of lineage trees. We found that adding one multistable switch of any type had a modest effect on increasing the proportion of well-separated attractor pairs. Adding two identical switches of any type had a much stronger effect in increasing the proportion of well-separated attractors. Similarly, there was an increase in the frequency of directional transitions between attractor pairs when two identical multistable switches were added to GRNs. This effect on directionality was not observed when only one multistable switch was added. CONCLUSIONS: This work provides evidence that the occurrence of multistable switches in networks that control cellular differentiation contributes to the structure of lineage trees and to the stabilization of cell types.

Biocellion: accelerating computer simulation of multicellular biological system models.

MOTIVATION: Biological system behaviors are often the outcome of complex interactions among a large number of cells and their biotic and abiotic environment. Computational biologists attempt to understand, predict and manipulate biological system behavior through mathematical modeling and computer simulation. Discrete agent-based modeling (in combination with high-resolution grids to model the extracellular environment) is a popular approach for building biological system models. However, the computational complexity of this approach forces computational biologists to resort to coarser resolution approaches to simulate large biological systems. High-performance parallel computers have the potential to address the computing challenge, but writing efficient software for parallel computers is difficult and time-consuming. RESULTS: We have developed Biocellion, a high-performance software framework, to solve this computing challenge using parallel computers. To support a wide range of multicellular biological system models, Biocellion asks users to provide their model specifics by filling the function body of pre-defined model routines. Using Biocellion, modelers without parallel computing expertise can efficiently exploit parallel computers with less effort than writing sequential programs from scratch. We simulate cell sorting, microbial patterning and a bacterial system in soil aggregate as case studies. AVAILABILITY AND IMPLEMENTATION: Biocellion runs on x86 compatible systems with the 64 bit Linux operating system and is freely available for academic use. Visit http://biocellion.com for additional information.

Modeling and visualizing cell type switching.

Understanding cellular differentiation is critical in explaining development and for taming diseases such as cancer. Differentiation is conventionally represented using bifurcating lineage trees. However, these lineage trees cannot readily capture or quantify all the types of transitions now known to occur between cell types, including transdifferentiation or differentiation off standard paths. This work introduces a new analysis and visualization technique that is capable of representing all possible transitions between cell states compactly, quantitatively, and intuitively. This method considers the regulatory network of transcription factors that control cell type determination and then performs an analysis of network dynamics to identify stable expression profiles and the potential cell types that they represent. A visualization tool called CellDiff3D creates an intuitive three-dimensional graph that shows the overall direction and probability of transitions between all pairs of cell types within a lineage. In this study, the influence of gene expression noise and mutational changes during myeloid cell differentiation are presented as a demonstration of the CellDiff3D technique, a new approach to quantify and envision all possible cell state transitions in any lineage network.

Maximizing Kolmogorov Complexity for accurate and robust bright field cell segmentation.

BACKGROUND: Analysis of cellular processes with microscopic bright field defocused imaging has the advantage of low phototoxicity and minimal sample preparation. However bright field images lack the contrast and nuclei reporting available with florescent approaches and therefore present a challenge to methods that segment and track the live cells. Moreover, such methods must be robust to systemic and random noise, variability in experimental configuration, and the multiple unknowns in the biological system under study. RESULTS: A new method called maximal-information is introduced that applies a non-parametric information theoretic approach to segment bright field defocused images. The method utilizes a combinatorial optimization strategy to select specific defocused images from each image stack such that set complexity, a Kolmogorov complexity measure, is maximized. Differences among these selected images are then applied to initialize and guide a level set based segmentation algorithm. The performance of the method is compared with a recent approach that uses a fixed defocused image selection strategy over an image data set of embryonic kidney cells (HEK 293T) from multiple experiments. Results demonstrate that the adaptive maximal-information approach significantly improves precision and recall of segmentation over the diversity of data sets. CONCLUSIONS: Integrating combinatorial optimization with non-parametric Kolmogorov complexity has been shown to be effective in extracting information from microscopic bright field defocused images. The approach is application independent and has the potential to be effective in processing a diversity of noisy and redundant high throughput biological data.

Kolmogorov complexity of epithelial pattern formation: the role of regulatory network configuration.

The tissues of multicellular organisms are made of differentiated cells arranged in organized patterns. This organization emerges during development from the coupling of dynamic intra- and intercellular regulatory networks. This work applies the methods of information theory to understand how regulatory network structure both within and between cells relates to the complexity of spatial patterns that emerge as a consequence of network operation. A computational study was performed in which undifferentiated cells were arranged in a two dimensional lattice, with gene expression in each cell regulated by identical intracellular randomly generated Boolean networks. Cell-cell contact signalling between embryonic cells is modeled as coupling among intracellular networks so that gene expression in one cell can influence the expression of genes in adjacent cells. In this system, the initially identical cells differentiate and form patterns of different cell types. The complexity of network structure, temporal dynamics and spatial organization is quantified through the Kolmogorov-based measures of normalized compression distance and set complexity. Results over sets of random networks that operate in the ordered, critical and chaotic domains demonstrate that: (1) ordered and critical networks tend to create the most information-rich patterns; (2) signalling configurations in which cell-to-cell communication is non-directional mostly produce simple patterns irrespective of the internal network domain; and (3) directional signalling configurations, similar to those that function in planar cell polarity, produce the most complex patterns, but only when the intracellular networks function in non-chaotic domains.

Multiobjective optimization based-approach for discovering novel cancer therapies.

Solid tumors must recruit new blood vessels for growth and maintenance. Discovering drugs that block tumor-induced development of new blood vessels (angiogenesis) is an important approach in cancer treatment. The complexity of angiogenesis presents both challenges and opportunities for cancer therapies. Intuitive approaches, such as blocking VegF activity, have yielded important therapies. But there maybe opportunities to alter nonintuitive targets either alone or in combination. This paper describes the development of a high-fidelity simulation of angiogenesis and uses this as the basis for a parallel search-based approach for the discovery of novel potential cancer treatments that inhibit blood vessel growth. Discovering new therapies is viewed as a multiobjective combinatorial optimization over two competing objectives: minimizing the estimated cost of practically developing the intervention while minimizing the simulated oxygen provided to the tumor by angiogenesis. Results show the effectiveness of the search process by finding interventions that are currently in use, and more interestingly, discovering potential new approaches that are nonintuitive yet effective.

Regular mosaic pattern development: a study of the interplay between lateral inhibition, apoptosis and differential adhesion.

BACKGROUND: A significant body of literature is devoted to modeling developmental mechanisms that create patterns within groups of initially equivalent embryonic cells. Although it is clear that these mechanisms do not function in isolation, the timing of and interactions between these mechanisms during embryogenesis is not well known. In this work, a computational approach was taken to understand how lateral inhibition, differential adhesion and programmed cell death can interact to create a mosaic pattern of biologically realistic primary and secondary cells, such as that formed by sensory (primary) and supporting (secondary) cells of the developing chick inner ear epithelium. RESULTS: Four different models that interlaced cellular patterning mechanisms in a variety of ways were examined and their output compared to the mosaic of sensory and supporting cells that develops in the chick inner ear sensory epithelium. The results show that: 1) no single patterning mechanism can create a 2-dimensional mosaic pattern of the regularity seen in the chick inner ear; 2) cell death was essential to generate the most regular mosaics, even through extensive cell death has not been reported for the developing basilar papilla; 3) a model that includes an iterative loop of lateral inhibition, programmed cell death and cell rearrangements driven by differential adhesion created mosaics of primary and secondary cells that are more regular than the basilar papilla; 4) this same model was much more robust to changes in homo- and heterotypic cell-cell adhesive differences than models that considered either fewer patterning mechanisms or single rather than iterative use of each mechanism. CONCLUSION: Patterning the embryo requires collaboration between multiple mechanisms that operate iteratively. Interlacing these mechanisms into feedback loops not only refines the output patterns, but also increases the robustness of patterning to varying initial cell states.