Scalable synchronization cluster in networked chaotic oscillators.

Cluster synchronization in synthetic networks of coupled chaotic oscillators is investigated. It is found that despite the asymmetric nature of the network structure, a subset of the oscillators can be synchronized as a cluster while the other oscillators remain desynchronized. Interestingly, with the increase in the coupling strength, the cluster is expanding gradually by recruiting the desynchronized oscillators one by one. This new synchronization phenomenon, which is named "scalable synchronization cluster," is explored theoretically by the method of eigenvector-based analysis, and it is revealed that the scalability of the cluster is attributed to the unique feature of the eigenvectors of the network coupling matrix. The transient dynamics of the cluster in response to random perturbations are also studied, and it is shown that in restoring to the synchronization state, oscillators inside the cluster are stabilized in sequence, illustrating again the hierarchy of the oscillators. The findings shed new light on the collective behaviors of networked chaotic oscillators and are helpful for the design of real-world networks where scalable synchronization clusters are concerned.

Folding State within a Hysteresis Loop: Hidden Multistability in Nonlinear Physical Systems.

Identifying hidden states in nonlinear physical systems that evade direct experimental detection is important as disturbances and noises can place the system in a hidden state with detrimental consequences. We study a cavity magnonic system whose main physics is photon and magnon Kerr effects. Sweeping a bifurcation parameter in numerical experiments (as would be done in actual experiments) leads to a hysteresis loop with two distinct stable steady states, but analytic calculation gives a third folded steady state "hidden" in the loop, which gives rise to the phenomenon of hidden multistability. We propose an experimentally feasible control method to drive the system into the folded hidden state. We demonstrate, through a ternary cavity magnonic system and a gene regulatory network, that such hidden multistability is in fact quite common. Our findings shed light on hidden dynamical states in nonlinear physical systems which are not directly observable but can present challenges and opportunities in applications.

Reconstructing bifurcation diagrams of chaotic circuits with reservoir computing.

Model-free reconstruction of bifurcation diagrams of Chua's circuits using the technique of parameter-aware reservoir computing is investigated. We demonstrate that (1) reservoir computer can be utilized as a noise filter to restore the system dynamics from noisy signals; (2) for a single Chua circuit, a machine trained by the noisy time series measured at several sampling states is capable of reconstructing the whole bifurcation diagram of the circuit with a high precision; and (3) for two coupled chaotic Chua circuits with mismatched parameters, the machine trained by the noisy time series measured at several coupling strengths is able to anticipate the variation of the synchronization degree of the coupled circuits with respect to the coupling strength over a wide range. Our studies verify the capability of the technique of parameter-aware reservoir computing in learning the dynamics of chaotic circuits from noisy signals, signifying the potential application of this technique in reconstructing the bifurcation diagram of real-world chaotic systems.

Breathing cluster in complex neuron-astrocyte networks.

Brain activities are featured by spatially distributed neural clusters of coherent firings and a spontaneous slow switching of the clusters between the coherent and incoherent states. Evidences from recent in vivo experiments suggest that astrocytes, a type of glial cell regarded previously as providing only structural and metabolic supports to neurons, participate actively in brain functions by regulating the neural firing activities, yet the underlying mechanism remains unknown. Here, introducing astrocyte as a reservoir of the glutamate released from the neuron synapses, we propose the model of the complex neuron-astrocyte network, and investigate the roles of astrocytes in regulating the cluster synchronization behaviors of networked chaotic neurons. It is found that a specific set of neurons on the network are synchronized and form a cluster, while the remaining neurons are kept as desynchronized. Moreover, during the course of network evolution, the cluster is switching between the synchrony and asynchrony states in an intermittent fashion, henceforth the phenomenon of "breathing cluster." By the method of symmetry-based analysis, we conduct a theoretical investigation on the synchronizability of the cluster. It is revealed that the contents of the cluster are determined by the network symmetry, while the breathing of the cluster is attributed to the interplay between the neural network and the astrocyte. The phenomenon of breathing cluster is demonstrated in different network models, including networks with different sizes, nodal dynamics, and coupling functions. The findings shed light on the cellular mechanism of astrocytes in regulating neural activities and give insights into the state-switching of the neocortex.

Inferring synchronizability of networked heterogeneous oscillators with machine learning.

In the study of network synchronization, an outstanding question of both theoretical and practical significance is how to allocate a given set of heterogeneous oscillators on a complex network in order to improve the synchronization performance. Whereas methods have been proposed to address this question in the literature, the methods are all based on accurate models describing the system dynamics, which, however, are normally unavailable in realistic situations. Here, we show that this question can be addressed by the model-free technique of a feed-forward neural network (FNN) in machine learning. Specifically, we measure the synchronization performance of a number of allocation schemes and use the measured data to train a machine. It is found that the trained machine is able to not only infer the synchronization performance of any new allocation scheme, but also find from a huge amount of candidates the optimal allocation scheme for synchronization.

Anticipating measure synchronization in coupled Hamiltonian systems with machine learning.

A model-free approach is proposed for anticipating the occurrence of measure synchronization in coupled Hamiltonian systems. Specifically, by the technique of parameter-aware reservoir computing in machine learning, we demonstrate that the machine trained by the time series of coupled Hamiltonian systems at a handful of coupling parameters is able to predict accurately not only the critical coupling for the occurrence of measure synchronization, but also the variation of the system order parameters around the transition point. The capability of the model-free technique in anticipating measure synchronization is exemplified in Hamiltonian systems of two coupled oscillators and also in a Hamiltonian system of three globally coupled oscillators where partial synchronization arises. The studies pave a way to the model-free, data-driven analysis of measure synchronization in large-size Hamiltonian systems.

Criticality in reservoir computer of coupled phase oscillators.

Accumulating evidence shows that the cerebral cortex is operating near a critical state featured by power-law size distribution of neural avalanche activities, yet evidence of this critical state in artificial neural networks mimicking the cerebral cortex is still lacking. Here we design an artificial neural network of coupled phase oscillators and, by the technique of reservoir computing in machine learning, train it for predicting chaos. It is found that when the machine is properly trained, oscillators in the reservoir are synchronized into clusters whose sizes follow a power-law distribution. This feature, however, is absent when the machine is poorly trained. Additionally, it is found that despite the synchronization degree of the original network, once properly trained, the reservoir network is always developed to the same critical state, exemplifying the "attractor" nature of this state in machine learning. The generality of the results is verified in different reservoir models and by different target systems, and it is found that the scaling exponent of the distribution is independent of the reservoir details and the bifurcation parameters of the target system, but is modified when the dynamics of the target system is changed to a different type. The findings shed light on the nature of machine learning, and are helpful to the design of high-performance machines in physical systems.

Synchronization within synchronization: transients and intermittency in ecological networks.

Transients are fundamental to ecological systems with significant implications to management, conservation and biological control. We uncover a type of transient synchronization behavior in spatial ecological networks whose local dynamics are of the chaotic, predator-prey type. In the parameter regime where there is phase synchronization among all the patches, complete synchronization (i.e. synchronization in both phase and amplitude) can arise in certain pairs of patches as determined by the network symmetry-henceforth the phenomenon of 'synchronization within synchronization.' Distinct patterns of complete synchronization coexist but, due to intrinsic instability or noise, each pattern is a transient and there is random, intermittent switching among the patterns in the course of time evolution. The probability distribution of the transient time is found to follow an algebraic scaling law with a divergent average transient lifetime. Based on symmetry considerations, we develop a stability analysis to understand these phenomena. The general principle of symmetry can also be exploited to explain previously discovered, counterintuitive synchronization behaviors in ecological networks.

Learning Hamiltonian dynamics with reservoir computing.

Reconstructing the Kolmogorov-Arnold-Moser (KAM) dynamics diagram of Hamiltonian system from the time series of a limited number of parameters is an outstanding question in nonlinear science, especially when the Hamiltonian governing the system dynamics is unknown. Here we demonstrate that this question can be addressed by the machine learning approach knowing as reservoir computing (RC). Specifically, we show that without prior knowledge about the Hamilton equations of motion, the trained RC is able to not only predict the short-term evolution of the system state, but also replicate the long-term ergodic properties of the system dynamics. Furthermore, using the architecture of parameter-aware RC, we show that the RC trained by the time series acquired at a handful parameters is able to reconstruct the entire KAM dynamics diagram with a high precision by tuning a control parameter externally. The feasibility and efficiency of the learning techniques are demonstrated in two classical nonlinear Hamiltonian systems, namely, the double-pendulum oscillator and the standard map. Our study indicates that, as a complex dynamical system, RC is able to learn from data the Hamiltonian.

Transfer learning of chaotic systems.

Can a neural network trained by the time series of system A be used to predict the evolution of system B? This problem, knowing as transfer learning in a broad sense, is of great importance in machine learning and data mining yet has not been addressed for chaotic systems. Here, we investigate transfer learning of chaotic systems from the perspective of synchronization-based state inference, in which a reservoir computer trained by chaotic system A is used to infer the unmeasured variables of chaotic system B, while A is different from B in either parameter or dynamics. It is found that if systems A and B are different in parameter, the reservoir computer can be well synchronized to system B. However, if systems A and B are different in dynamics, the reservoir computer fails to synchronize with system B in general. Knowledge transfer along a chain of coupled reservoir computers is also studied, and it is found that, although the reservoir computers are trained by different systems, the unmeasured variables of the driving system can be successfully inferred by the remote reservoir computer. Finally, by an experiment of chaotic pendulum, we demonstrate that the knowledge learned from the modeling system can be transferred and used to predict the evolution of the experimental system.

Cluster synchronization in networked nonidentical chaotic oscillators.

In exploring oscillator synchronization, a general observation is that as the oscillators become nonidentical, e.g., introducing parameter mismatch among the oscillators, the propensity for synchronization will be deteriorated. Yet in realistic systems, parameter mismatch is unavoidable and even worse in some circumstances, the oscillators might follow different types of dynamics. Considering the significance of synchronization to the functioning of many realistic systems, it is natural to ask the following question: Can synchronization be achieved in networked oscillators of clearly different parameters or dynamics? Here, by the model of networked chaotic oscillators, we are able to demonstrate and argue that, despite the presence of parameter mismatch (or different dynamics), stable synchronization can still be achieved on symmetric complex networks. Specifically, we find that when the oscillators are configured on the network in such a way that the symmetric nodes have similar parameters (or follow the same type of dynamics), cluster synchronization can be generated. The stabilities of the cluster synchronization states are analyzed by the method of symmetry-based stability analysis, with the theoretical predictions in good agreement with the numerical results. Our study sheds light on the interplay between symmetry and cluster synchronization in complex networks and give insights into the functionalities of realistic systems where nonidentical nonlinear oscillators are presented and cluster synchronization is crucial.

Enhancing network synchronizability by strengthening a single node.

In improving the stability of complex dynamical systems, an outstanding problem is how to achieve the desired performance at a low cost. For engineering and biological complex systems whose performance and functionality rely on the synchronous motion of their units, an important question related to the performance-cost-balance problem is how to improve efficiently the system synchronizability when a small amount of additional coupling resource is available. Here, employing a complex network of coupled chaotic oscillators as the model, we address this question by introducing a small amount of coupling intensity to only a single oscillator and investigate how the improvement of the network synchronizability is dependent on the location of the target oscillator. Theoretical analysis shows that, to achieve the maximum network synchronizability, the target oscillator to be strengthened should be chosen according to the eigenvector of the most unstable mode. Based on the theoretical finding, we further propose a single-node-based scheme for improving synchronization: the eigenvector-centrality-based strengthening scheme. We describe in detail how to apply this scheme under different synchronization scenarios and justify its efficiency in various network models by numerical simulations. The performance of the new scheme is compared with the conventional ones based on betweenness, closeness, and degree centralities, and it is shown that the new scheme has a clear advantage over the conventional ones. Furthermore, by a brute-force search of the target oscillator over the network, it is verified numerically that the oscillator identified by the new scheme indeed gives the best synchronization performance.

Enhancing network synchronization by phase modulation.

Due to time delays in signal transmission and processing, phase lags are inevitable in realistic complex oscillator networks. Conventional wisdom is that phase lags are detrimental to network synchronization. Here we show that judiciously chosen phase lag modulations can result in significantly enhanced network synchronization. We justify our strategy of phase modulation, demonstrate its power in facilitating and enhancing network synchronization with synthetic and empirical network models, and provide an analytic understanding of the underlying mechanism. Our work provides an alternative approach to synchronization optimization in complex networks, with insights into control of complex nonlinear networks.

Autapses promote synchronization in neuronal networks.

Neurological disorders such as epileptic seizures are believed to be caused by neuronal synchrony. However, to ascertain the causal role of neuronal synchronization in such diseases through the traditional approach of electrophysiological data analysis remains a controversial, challenging, and outstanding problem. We offer an alternative principle to assess the physiological role of neuronal synchrony based on identifying structural anomalies in the underlying network and studying their impacts on the collective dynamics. In particular, we focus on autapses - time delayed self-feedback links that exist on a small fraction of neurons in the network, and investigate their impacts on network synchronization through a detailed stability analysis. Our main finding is that the proper placement of a small number of autapses in the network can promote synchronization significantly, providing the computational and theoretical bases for hypothesizing a high degree of synchrony in real neuronal networks with autapses. Our result that autapses, the shortest possible links in any network, can effectively modulate the collective dynamics provides also a viable strategy for optimal control of complex network dynamics at minimal cost.

Controlling synchronous patterns in complex networks.

Although the set of permutation symmetries of a complex network could be very large, few of them give rise to stable synchronous patterns. Here we present a general framework and develop techniques for controlling synchronization patterns in complex network of coupled chaotic oscillators. Specifically, according to the network permutation symmetry, we design a small-size and weighted network, namely the control network, and use it to control the large-size complex network by means of pinning coupling. We argue mathematically that for any of the network symmetries, there always exists a critical pinning strength beyond which the unstable synchronous pattern associated to this symmetry can be stabilized. The feasibility of the control method is verified by numerical simulations of both artificial and real-world networks and demonstrated experimentally in systems of coupled chaotic circuits. Our studies show the controllability of synchronous patterns in complex networks of coupled chaotic oscillators.

Growth, collapse, and self-organized criticality in complex networks.

Network growth is ubiquitous in nature (e.g., biological networks) and technological systems (e.g., modern infrastructures). To understand how certain dynamical behaviors can or cannot persist as the underlying network grows is a problem of increasing importance in complex dynamical systems as well as sustainability science and engineering. We address the question of whether a complex network of nonlinear oscillators can maintain its synchronization stability as it expands. We find that a large scale avalanche over the entire network can be triggered in the sense that the individual nodal dynamics diverges from the synchronous state in a cascading manner within a relatively short time period. In particular, after an initial stage of linear growth, the network typically evolves into a critical state where the addition of a single new node can cause a group of nodes to lose synchronization, leading to synchronization collapse for the entire network. A statistical analysis reveals that the collapse size is approximately algebraically distributed, indicating the emergence of self-organized criticality. We demonstrate the generality of the phenomenon of synchronization collapse using a variety of complex network models, and uncover the underlying dynamical mechanism through an eigenvector analysis.