Cell reprogramming design by transfer learning of functional transcriptional networks.

Recent developments in synthetic biology, next-generation sequencing, and machine learning provide an unprecedented opportunity to rationally design new disease treatments based on measured responses to gene perturbations and drugs to reprogram cells. The main challenges to seizing this opportunity are the incomplete knowledge of the cellular network and the combinatorial explosion of possible interventions, both of which are insurmountable by experiments. To address these challenges, we develop a transfer learning approach to control cell behavior that is pre-trained on transcriptomic data associated with human cell fates, thereby generating a model of the network dynamics that can be transferred to specific reprogramming goals. The approach combines transcriptional responses to gene perturbations to minimize the difference between a given pair of initial and target transcriptional states. We demonstrate our approach's versatility by applying it to a microarray dataset comprising >9,000 microarrays across 54 cell types and 227 unique perturbations, and an RNASeq dataset consisting of >10,000 sequencing runs across 36 cell types and 138 perturbations. Our approach reproduces known reprogramming protocols with an AUROC of 0.91 while innovating over existing methods by pre-training an adaptable model that can be tailored to specific reprogramming transitions. We show that the number of gene perturbations required to steer from one fate to another increases with decreasing developmental relatedness and that fewer genes are needed to progress along developmental paths than to regress. These findings establish a proof-of-concept for our approach to computationally design control strategies and provide insights into how gene regulatory networks govern phenotype.

Braess's paradox and programmable behaviour in microfluidic networks.

Microfluidic systems are now being designed with precision as miniaturized fluid manipulation devices that can execute increasingly complex tasks. However, their operation often requires numerous external control devices owing to the typically linear nature of microscale flows, which has hampered the development of integrated control mechanisms. Here we address this difficulty by designing microfluidic networks that exhibit a nonlinear relation between the applied pressure and the flow rate, which can be harnessed to switch the direction of internal flows solely by manipulating the input and/or output pressures. We show that these networks- implemented using rigid polymer channels carrying water-exhibit an experimentally supported fluid analogue of Braess's paradox, in which closing an intermediate channel results in a higher, rather than lower, total flow rate. The harnessed behaviour is scalable and can be used to implement flow routing with multiple switches. These findings have the potential to advance the development of built-in control mechanisms in microfluidic networks, thereby facilitating the creation of portable systems and enabling novel applications in areas ranging from wearable healthcare technologies to deployable space systems.

Prevalence and scalable control of localized networks.

The ability to control network dynamics is essential for ensuring desirable functionality of many technological, biological, and social systems. Such systems often consist of a large number of network elements, and controlling large-scale networks remains challenging because the computation and communication requirements increase prohibitively fast with network size. Here, we introduce a notion of network locality that can be exploited to make the control of networks scalable, even when the dynamics are nonlinear. We show that network locality is captured by an information metric and is almost universally observed across real and model networks. In localized networks, the optimal control actions and system responses are both shown to be necessarily concentrated in small neighborhoods induced by the information metric. This allows us to develop localized algorithms for determining network controllability and optimizing the placement of driver nodes. This also allows us to develop a localized algorithm for designing local feedback controllers that approach the performance of the corresponding best global controllers, while incurring a computational cost orders-of-magnitude lower. We validate the locality, performance, and efficiency of the algorithms in Kuramoto oscillator networks, as well as three large empirical networks: synchronization dynamics in the Eastern US power grid, epidemic spreading mediated by the global air-transportation network, and Alzheimer's disease dynamics in a human brain network. Taken together, our results establish that large networks can be controlled with computation and communication costs comparable to those for small networks.

Functional observability and target state estimation in large-scale networks.

The quantitative understanding and precise control of complex dynamical systems can only be achieved by observing their internal states via measurement and/or estimation. In large-scale dynamical networks, it is often difficult or physically impossible to have enough sensor nodes to make the system fully observable. Even if the system is in principle observable, high dimensionality poses fundamental limits on the computational tractability and performance of a full-state observer. To overcome the curse of dimensionality, we instead require the system to be functionally observable, meaning that a targeted subset of state variables can be reconstructed from the available measurements. Here, we develop a graph-based theory of functional observability, which leads to highly scalable algorithms to 1) determine the minimal set of required sensors and 2) design the corresponding state observer of minimum order. Compared with the full-state observer, the proposed functional observer achieves the same estimation quality with substantially less sensing and fewer computational resources, making it suitable for large-scale networks. We apply the proposed methods to the detection of cyberattacks in power grids from limited phase measurement data and the inference of the prevalence rate of infection during an epidemic under limited testing conditions. The applications demonstrate that the functional observer can significantly scale up our ability to explore otherwise inaccessible dynamical processes on complex networks.

Random heterogeneity outperforms design in network synchronization.

A widely held assumption on network dynamics is that similar components are more likely to exhibit similar behavior than dissimilar ones and that generic differences among them are necessarily detrimental to synchronization. Here, we show that this assumption does not generally hold in oscillator networks when communication delays are present. We demonstrate, in particular, that random parameter heterogeneity among oscillators can consistently rescue the system from losing synchrony. This finding is supported by electrochemical-oscillator experiments performed on a multielectrode array network. Remarkably, at intermediate levels of heterogeneity, random mismatches are more effective in promoting synchronization than parameter assignments specifically designed to facilitate identical synchronization. Our results suggest that, rather than being eliminated or ignored, intrinsic disorder in technological and biological systems can be harnessed to help maintain coherence required for function.

Prevalence of multistability and nonstationarity in driven chemical networks.

External flows of energy, entropy, and matter can cause sudden transitions in the stability of biological and industrial systems, fundamentally altering their dynamical function. How might we control and design these transitions in chemical reaction networks? Here, we analyze transitions giving rise to complex behavior in random reaction networks subject to external driving forces. In the absence of driving, we characterize the uniqueness of the steady state and identify the percolation of a giant connected component in these networks as the number of reactions increases. When subject to chemical driving (influx and outflux of chemical species), the steady state can undergo bifurcations, leading to multistability or oscillatory dynamics. By quantifying the prevalence of these bifurcations, we show how chemical driving and network sparsity tend to promote the emergence of these complex dynamics and increased rates of entropy production. We show that catalysis also plays an important role in the emergence of complexity, strongly correlating with the prevalence of bifurcations. Our results suggest that coupling a minimal number of chemical signatures with external driving can lead to features present in biochemical processes and abiogenesis.

Predicting growth rate from gene expression.

Growth rate is one of the most important and most complex phenotypic characteristics of unicellular microorganisms, which determines the genetic mutations that dominate at the population level, and ultimately whether the population will survive. Translating changes at the genetic level to their growth-rate consequences remains a subject of intense interest, since such a mapping could rationally direct experiments to optimize antibiotic efficacy or bioreactor productivity. In this work, we directly map transcriptional profiles to growth rates by gathering published gene-expression data from Escherichia coli and Saccharomyces cerevisiae with corresponding growth-rate measurements. Using a machine-learning technique called k-nearest-neighbors regression, we build a model which predicts growth rate from gene expression. By exploiting the correlated nature of gene expression and sparsifying the model, we capture 81% of the variance in growth rate of the E. coli dataset, while reducing the number of features from >4,000 to 9. In S. cerevisiae, we account for 89% of the variance in growth rate, while reducing from >5,500 dimensions to 18. Such a model provides a basis for selecting successful strategies from among the combinatorial number of experimental possibilities when attempting to optimize complex phenotypic traits like growth rate.

Mechanism for Strong Chimeras.

Chimera states have attracted significant attention as symmetry-broken states exhibiting the unexpected coexistence of coherence and incoherence. Despite the valuable insights gained from analyzing specific systems, an understanding of the general physical mechanism underlying the emergence of chimeras is still lacking. Here, we show that many stable chimeras arise because coherence in part of the system is sustained by incoherence in the rest of the system. This mechanism may be regarded as a deterministic analog of noise-induced synchronization and is shown to underlie the emergence of strong chimeras. These are chimera states whose coherent domain is formed by identically synchronized oscillators. Recognizing this mechanism offers a new meaning to the interpretation that chimeras are a natural link between coherence and incoherence.

Synchronizing Chaos with Imperfections.

Previous research on nonlinear oscillator networks has shown that chaos synchronization is attainable for identical oscillators but deteriorates in the presence of parameter mismatches. Here, we identify regimes for which the opposite occurs and show that oscillator heterogeneity can synchronize chaos for conditions under which identical oscillators cannot. This effect is not limited to small mismatches and is observed for random oscillator heterogeneity on both homogeneous and heterogeneous network structures. The results are demonstrated experimentally using networks of Chua's oscillators and are further supported by numerical simulations and theoretical analysis. In particular, we propose a general mechanism based on heterogeneity-induced mode mixing that provides insights into the observed phenomenon. Since individual differences are ubiquitous and often unavoidable in real systems, it follows that such imperfections can be an unexpected source of synchronization stability.

Correction: Experimental evolution of diverse Escherichia coli metabolic mutants identifies genetic loci for convergent adaptation of growth rate.

[This corrects the article DOI: 10.1371/journal.pgen.1007284.].

Experimental evolution of diverse Escherichia coli metabolic mutants identifies genetic loci for convergent adaptation of growth rate.

Cell growth is determined by substrate availability and the cell's metabolic capacity to assimilate substrates into building blocks. Metabolic genes that determine growth rate may interact synergistically or antagonistically, and can accelerate or slow growth, depending on genetic background and environmental conditions. We evolved a diverse set of Escherichia coli single-gene deletion mutants with a spectrum of growth rates and identified mutations that generally increase growth rate. Despite the metabolic differences between parent strains, mutations that enhanced growth largely mapped to core transcription machinery, including the ß and ß' subunits of RNA polymerase (RNAP) and the transcription elongation factor, NusA. The structural segments of RNAP that determine enhanced growth have been previously implicated in antibiotic resistance and in the control of transcription elongation and pausing. We further developed a computational framework to characterize how the transcriptional changes that occur upon acquisition of these mutations affect growth rate across strains. Our experimental and computational results provide evidence for cases in which RNAP mutations shift the competitive balance between active transcription and gene silencing. This study demonstrates that mutations in specific regions of RNAP are a convergent adaptive solution that can enhance the growth rate of cells from distinct metabolic states.

Extreme Antagonism Arising from Gene-Environment Interactions.

Antagonistic interactions in biological systems, which occur when one perturbation blunts the effect of another, are typically interpreted as evidence that the two perturbations impact the same cellular pathway or function. Yet, this interpretation ignores extreme antagonistic interactions wherein an otherwise deleterious perturbation compensates for the function lost because of a prior perturbation. Here, we report on gene-environment interactions involving genetic mutations that are deleterious in a permissive environment but beneficial in a specific environment that restricts growth. These extreme antagonistic interactions constitute gene-environment analogs of synthetic rescues previously observed for gene-gene interactions. Our approach uses two independent adaptive evolution steps to address the lack of experimental methods to systematically identify such extreme interactions. We apply the approach to Escherichia coli by successively adapting it to defined glucose media without and with the antibiotic rifampicin. The approach identified multiple mutations that are beneficial in the presence of rifampicin and deleterious in its absence. The analysis of transcription shows that the antagonistic adaptive mutations repress a stringent response-like transcriptional program, whereas nonantagonistic mutations have an opposite transcriptional profile. Our approach represents a step toward the systematic characterization of extreme antagonistic gene-drug interactions, which can be used to identify targets to select against antibiotic resistance.

Coherent Dynamics Enhanced by Uncorrelated Noise.

Synchronization is a widespread phenomenon observed in physical, biological, and social networks, which persists even under the influence of strong noise. Previous research on oscillators subject to common noise has shown that noise can actually facilitate synchronization, as correlations in the dynamics can be inherited from the noise itself. However, in many spatially distributed networks, such as the mammalian circadian system, the noise that different oscillators experience can be effectively uncorrelated. Here, we show that uncorrelated noise can in fact enhance synchronization when the oscillators are coupled. Strikingly, our analysis also shows that uncorrelated noise can be more effective than common noise in enhancing synchronization. We first establish these results theoretically for phase and phase-amplitude oscillators subject to either or both additive and multiplicative noise. We then confirm the predictions through experiments on coupled electrochemical oscillators. Our findings suggest that uncorrelated noise can promote rather than inhibit coherence in natural systems and that the same effect can be harnessed in engineered systems.

Topological Control of Synchronization Patterns: Trading Symmetry for Stability.

Symmetries are ubiquitous in network systems and have profound impacts on the observable dynamics. At the most fundamental level, many synchronization patterns are induced by underlying network symmetry, and a high degree of symmetry is believed to enhance the stability of identical synchronization. Yet, here we show that the synchronizability of almost any symmetry cluster in a network of identical nodes can be enhanced precisely by breaking its structural symmetry. This counterintuitive effect holds for generic node dynamics and arbitrary network structure and is, moreover, robust against noise and imperfections typical of real systems, which we demonstrate by implementing a state-of-the-art optoelectronic experiment. These results lead to new possibilities for the topological control of synchronization patterns, which we substantiate by presenting an algorithm that optimizes the structure of individual clusters under various constraints.

Publisher's Note: Incoherence-Mediated Remote Synchronization [Phys. Rev. Lett. 118, 174102 (2017)].

This corrects the article DOI: 10.1103/PhysRevLett.118.174102.

Vulnerability and Cosusceptibility Determine the Size of Network Cascades.

In a network, a local disturbance can propagate and eventually cause a substantial part of the system to fail in cascade events that are easy to conceptualize but extraordinarily difficult to predict. Here, we develop a statistical framework that can predict cascade size distributions by incorporating two ingredients only: the vulnerability of individual components and the cosusceptibility of groups of components (i.e., their tendency to fail together). Using cascades in power grids as a representative example, we show that correlations between component failures define structured and often surprisingly large groups of cosusceptible components. Aside from their implications for blackout studies, these results provide insights and a new modeling framework for understanding cascades in financial systems, food webs, and complex networks in general.

Cascading Failures as Continuous Phase-Space Transitions.

In network systems, a local perturbation can amplify as it propagates, potentially leading to a large-scale cascading failure. Here we derive a continuous model to advance our understanding of cascading failures in power-grid networks. The model accounts for both the failure of transmission lines and the desynchronization of power generators and incorporates the transient dynamics between successive steps of the cascade. In this framework, we show that a cascade event is a phase-space transition from an equilibrium state with high energy to an equilibrium state with lower energy, which can be suitably described in a closed form using a global Hamiltonian-like function. From this function, we show that a perturbed system cannot always reach the equilibrium state predicted by quasi-steady-state cascade models, which would correspond to a reduced number of failures, and may instead undergo a larger cascade. We also show that, in the presence of two or more perturbations, the outcome depends strongly on the order and timing of the individual perturbations. These results offer new insights into the current understanding of cascading dynamics, with potential implications for control interventions.

Incoherence-Mediated Remote Synchronization.

In previously identified forms of remote synchronization between two nodes, the intermediate portion of the network connecting the two nodes is not synchronized with them but generally exhibits some coherent dynamics. Here we report on a network phenomenon we call incoherence-mediated remote synchronization (IMRS), in which two noncontiguous parts of the network are identically synchronized while the dynamics of the intermediate part is statistically and information-theoretically incoherent. We identify mirror symmetry in the network structure as a mechanism allowing for such behavior, and show that IMRS is robust against dynamical noise as well as against parameter changes. IMRS may underlie neuronal information processing and potentially lead to network solutions for encryption key distribution and secure communication.

Stable Chimeras and Independently Synchronizable Clusters.

Cluster synchronization is a phenomenon in which a network self-organizes into a pattern of synchronized sets. It has been shown that diverse patterns of stable cluster synchronization can be captured by symmetries of the network. Here, we establish a theoretical basis to divide an arbitrary pattern of symmetry clusters into independently synchronizable cluster sets, in which the synchronization stability of the individual clusters in each set is decoupled from that in all the other sets. Using this framework, we suggest a new approach to find permanently stable chimera states by capturing two or more symmetry clusters-at least one stable and one unstable-that compose the entire fully symmetric network.

Chimera States in Continuous Media: Existence and Distinctness.

The defining property of chimera states is the coexistence of coherent and incoherent domains in systems that are structurally and spatially homogeneous. The recent realization that such states might be common in oscillator networks raises the question of whether an analogous phenomenon can occur in continuous media. Here, we show that chimera states can exist in continuous systems even when the coupling is strictly local, as in many fluid and pattern forming media. Using the complex Ginzburg-Landau equation as a model system, we characterize chimera states consisting of a coherent domain of a frozen spiral structure and an incoherent domain of amplitude turbulence. We show that in this case, in contrast with discrete network systems, fluctuations in the local coupling field play a crucial role in limiting the coherent regions. We suggest these findings shed light on new possible forms of coexisting order and disorder in fluid systems.