Quantifying synergy and redundancy between networks.

Understanding how different networks relate to each other is key for understanding complex systems. We introduce an intuitive yet powerful framework to disentangle different ways in which networks can be (dis)similar and complementary to each other. We decompose the shortest paths between nodes as uniquely contributed by one source network, or redundantly by either, or synergistically by both together. Our approach considers the networks' full topology, providing insights at multiple levels of resolution: from global statistics to individual paths. Our framework is widely applicable across scientific domains, from public transport to brain networks. In humans and 124 other species, we demonstrate the prevalence of unique contributions by long-range white-matter fibers in structural brain networks. Across species, efficient communication also relies on significantly greater synergy between long-range and short-range fibers than expected by chance. Our framework could find applications for designing network systems or evaluating existing ones.

Order-disorder transition in the zero-temperature Ising model on random graphs.

The zero-temperature Ising model is known to reach a fully ordered ground state in sufficiently dense random graphs. In sparse random graphs, the dynamics gets absorbed in disordered local minima at magnetization close to zero. Here, we find that the nonequilibrium transition between the ordered and the disordered regime occurs at an average degree that slowly grows with the graph size. The system shows bistability: The distribution of the absolute magnetization in the reached absorbing state is bimodal, with peaks only at zero and unity. For a fixed system size, the average time to absorption behaves nonmonotonically as a function of average degree. The peak value of the average absorption time grows as a power law of the system size. These findings have relevance for community detection, opinion dynamics, and games on networks.

Quick Estimate of Information Decomposition for Text Style Transfer.

A growing number of papers on style transfer for texts rely on information decomposition. The performance of the resulting systems is usually assessed empirically in terms of the output quality or requires laborious experiments. This paper suggests a straightforward information theoretical framework to assess the quality of information decomposition for latent representations in the context of style transfer. Experimenting with several state-of-the-art models, we demonstrate that such estimates could be used as a fast and straightforward health check for the models instead of more laborious empirical experiments.

Modelling Spirals of Silence and Echo Chambers by Learning from the Feedback of Others.

What are the mechanisms by which groups with certain opinions gain public voice and force others holding a different view into silence? Furthermore, how does social media play into this? Drawing on neuroscientific insights into the processing of social feedback, we develop a theoretical model that allows us to address these questions. In repeated interactions, individuals learn whether their opinion meets public approval and refrain from expressing their standpoint if it is socially sanctioned. In a social network sorted around opinions, an agent forms a distorted impression of public opinion enforced by the communicative activity of the different camps. Even strong majorities can be forced into silence if a minority acts as a cohesive whole. On the other hand, the strong social organisation around opinions enabled by digital platforms favours collective regimes in which opposing voices are expressed and compete for primacy in public. This paper highlights the role that the basic mechanisms of social information processing play in massive computer-mediated interactions on opinions.

The Rise of Populism and the Reconfiguration of the German Political Space.

The paper explores the notion of a reconfiguration of political space in the context of the rise of populism and its effects on the political system. We focus on Germany and the appearance of the new right wing party "Alternative for Germany" (AfD). The idea of a political space is closely connected to the ubiquitous use of spatial metaphors in political talk. In particular the idea of a "distance" between "political positions" would suggest that political actors are situated in a metric space. Using the electoral manifestos from the Manifesto project database we investigate to which extent the spatial metaphors so common in political talk can be brought to mathematical rigor. Many scholars of politics discuss the rise of the new populism in Western Europe and the United States with respect to a new political cleavage related to globalization, which is assumed to mainly affect the cultural dimension of the political space. As such, it might replace the older economic cleavage based on class divisions in defining the dominant dimension of political conflict. An explanation along these lines suggests a reconfiguration of the political space in the sense that 1) the main cleavage within the political space changes its direction from the economic axis towards the cultural axis, but 2) also the semantics of the cultural axis itself is changing towards globalization related topics. In this paper, we empirically address this reconfiguration of the political space by comparing political spaces for Germany built using topic modeling with the spaces based on the content analysis of the Manifesto project and the corresponding categories of political goals. We find that both spaces have a similar structure and that the AfD appears on a new dimension. In order to characterize this new dimension we employ a novel technique, inter-issue consistency networks (IICN) that allow to analyze the evolution of the correlations between the political positions on different issues over several elections. We find that the new dimension introduced by the AfD can be related to the split off of a new "cultural right" issue bundle from the previously existing center-right bundle.

Ideological differences in engagement in public debate on Twitter.

This article analyses public debate on Twitter via network representations of retweets and replies. We argue that tweets observable on Twitter have both a direct and mediated effect on the perception of public opinion. Through the interplay of the two networks, it is possible to identify potentially misleading representations of public opinion on the platform. The method is employed to observe public debate about two events: The Saxon state elections and violent riots in the city of Leipzig in 2019. We show that in both cases, (i) different opinion groups exhibit different propensities to get involved in debate, and therefore have unequal impact on public opinion. Users retweeting far-right parties and politicians are significantly more active, hence their positions are disproportionately visible. (ii) Said users act significantly more confrontational in the sense that they reply mostly to users from different groups, while the contrary is not the case.

Corrigendum: The Rise of Populism and the Reconfiguration of the German Political Space.

[This corrects the article DOI: 10.3389/fdata.2021.731349.].

Dynamics of opinion expression.

Modeling efforts in opinion dynamics have to a large extent ignored that opinion exchange between individuals can also have an effect on how willing they are to express their opinion publicly. Here, we introduce a model of public opinion expression. Two groups of agents with different opinion on an issue interact with each other, changing the willingness to express their opinion according to whether they perceive themselves as part of the majority or minority opinion. We formulate the model as a multigroup majority game and investigate the Nash equilibria. We also provide a dynamical systems perspective: Using the reinforcement learning algorithm of Q-learning, we reduce the N-agent system in a mean-field approach to two dimensions which represent the two opinion groups. This two-dimensional system is analyzed in a comprehensive bifurcation analysis of its parameters. The model identifies social-structural conditions for public opinion predominance of different groups. Among other findings, we show under which circumstances a minority can dominate public discourse.

The information theory of individuality.

Despite the near universal assumption of individuality in biology, there is little agreement about what individuals are and few rigorous quantitative methods for their identification. Here, we propose that individuals are aggregates that preserve a measure of temporal integrity, i.e., "propagate" information from their past into their futures. We formalize this idea using information theory and graphical models. This mathematical formulation yields three principled and distinct forms of individuality-an organismal, a colonial, and a driven form-each of which varies in the degree of environmental dependence and inherited information. This approach can be thought of as a Gestalt approach to evolution where selection makes figure-ground (agent-environment) distinctions using suitable information-theoretic lenses. A benefit of the approach is that it expands the scope of allowable individuals to include adaptive aggregations in systems that are multi-scale, highly distributed, and do not necessarily have physical boundaries such as cell walls or clonal somatic tissue. Such individuals might be visible to selection but hard to detect by observers without suitable measurement principles. The information theory of individuality allows for the identification of individuals at all levels of organization from molecular to cultural and provides a basis for testing assumptions about the natural scales of a system and argues for the importance of uncertainty reduction through coarse-graining in adaptive systems.

Oscillatory patterns in the electroencephalogram at sleep onset.

Falling asleep is a gradually unfolding process. We investigated the role of various oscillatory activities including sleep spindles and alpha and delta oscillations at sleep onset (SO) by automatically detecting oscillatory events. We used two datasets of healthy young males, eight with four baseline recordings, and eight with a baseline and recovery sleep after 40 h of sustained wakefulness. We analyzed the 2-min interval before SO (stage 2) and the five consecutive 2-min intervals after SO. The incidence of delta/theta events reached its maximum in the first 2-min episode after SO, while the frequency of them was continuously decreasing from stage 1 onwards, continuing over SO and further into deeper sleep. Interestingly, this decrease of the frequencies of the oscillations were not affected by increased sleep pressure, in contrast to the incidence which increased. We observed an increasing number of alpha events after SO, predominantly frontally, with their prevalence varying strongly across individuals. Sleep spindles started to occur after SO, with first an increasing then a decreasing incidence and a continuous decrease in their frequency. Again, the frequency of the spindles was not altered after sleep deprivation. Oscillatory events revealed derivation dependent aspects. However, these regional aspects were not specific of the process of SO but rather reflect a general sleep related phenomenon. No individual traits of SO features (incidence and frequency of oscillations) and their dynamics were observed. Delta/theta events are important features for the analysis of SO in addition to slow waves.

Developmental Changes in Sleep Oscillations during Early Childhood.

Although quantitative analysis of the sleep electroencephalogram (EEG) has uncovered important aspects of brain activity during sleep in adolescents and adults, similar findings from preschool-age children remain scarce. This study utilized our time-frequency method to examine sleep oscillations as characteristic features of human sleep EEG. Data were collected from a longitudinal sample of young children (n = 8; 3 males) at ages 2, 3, and 5 years. Following sleep stage scoring, we detected and characterized oscillatory events across age and examined how their features corresponded to spectral changes in the sleep EEG. Results indicated a developmental decrease in the incidence of delta and theta oscillations. Spindle oscillations, however, were almost absent at 2 years but pronounced at 5 years. All oscillatory event changes were stronger during light sleep than slow-wave sleep. Large interindividual differences in sleep oscillations and their characteristics (e.g., "ultrafast" spindle-like oscillations, theta oscillation incidence/frequency) also existed. Changes in delta and spindle oscillations across early childhood may indicate early maturation of the thalamocortical system. Our analytic approach holds promise for revealing novel types of sleep oscillatory events that are specific to periods of rapid normal development across the lifespan and during other times of aberrant changes in neurobehavioral function.

Closure measures for coarse-graining of the tent map.

We quantify the relationship between the dynamics of a time-discrete dynamical system, the tent map T and its iterations T(m), and the induced dynamics at a symbolical level in information theoretical terms. The symbol dynamics, given by a binary string s of length m, is obtained by choosing a partition point [Formula: see text] and lumping together the points [Formula: see text] s.t. T(i)(x) concurs with the i - 1th digit of s-i.e., we apply a so called threshold crossing technique. Interpreting the original dynamics and the symbolic one as different levels, this allows us to quantitatively evaluate and compare various closure measures that have been proposed for identifying emergent macro-levels of a dynamical system. In particular, we can see how these measures depend on the choice of the partition point α. As main benefit of this new information theoretical approach, we get all Markov partitions with full support of the time-discrete dynamical system induced by the tent map. Furthermore, we could derive an example of a Markovian symbol dynamics whose underlying partition is not Markovian at all, and even a whole hierarchy of Markovian symbol dynamics.

Effect of prolonged wakefulness on electroencephalographic oscillatory activity during sleep.

The human sleep electroencephalogram (EEG) is characterized by the occurrence of distinct oscillatory events such as delta waves, sleep spindles and alpha activity. We applied a previously proposed algorithm for the detection of such events and investigated their incidence and frequency in baseline and recovery sleep after 40 h of sustained wakefulness in 27 healthy young subjects. The changes in oscillatory events induced by sleep deprivation were compared to the corresponding spectral changes. Both approaches revealed, on average, an increase in low frequency activity and a decrease in spindle activity after sleep deprivation. However, the increase of oscillatory events in the delta range and decrease in the sigma range occurred in a more restricted frequency range compared to spectral changes. The mean relative power spectra showed a significant increase in theta and alpha activity after sleep deprivation while, on average, the event analysis showed only a weak effect in the theta band. The reason for this discrepancy is that the spectral analysis does not distinguish between diffuse activity and clearly visible temporally localized oscillations, while the event analysis would detect only the latter. Additionally, only a few individuals clearly showed activity in the theta or alpha frequency bands. Conversely, event analysis revealed that some individuals showed an increased rate of sleep spindles after sleep deprivation, a fact that was not evident in the relative power spectra due to a decrease in background activity. The two methods complement each other and facilitate the interpretation of distinct changes induced by prolonged wakefulness in sleep EEG.

Fading signatures of critical brain dynamics during sustained wakefulness in humans.

Sleep encompasses approximately a third of our lifetime, yet its purpose and biological function are not well understood. Without sleep optimal brain functioning such as responsiveness to stimuli, information processing, or learning may be impaired. Such observations suggest that sleep plays a crucial role in organizing or reorganizing neuronal networks of the brain toward states where information processing is optimized. Increasing evidence suggests that cortical neuronal networks operate near a critical state characterized by balanced activity patterns, which supports optimal information processing. However, it remains unknown whether critical dynamics is affected in the course of wake and sleep, which would also impact information processing. Here, we show that signatures of criticality are progressively disturbed during wake and restored by sleep. We demonstrate that the precise power-laws governing the cascading activity of neuronal avalanches and the distribution of phase-lock intervals in human electroencephalographic recordings are increasingly disarranged during sustained wakefulness. These changes are accompanied by a decrease in variability of synchronization. Interpreted in the context of a critical branching process, these seemingly different findings indicate a decline of balanced activity and progressive distance from criticality toward states characterized by an imbalance toward excitation where larger events prevail dynamics. Conversely, sleep restores the critical state resulting in recovered power-law characteristics in activity and variability of synchronization. These findings support the intriguing hypothesis that sleep may be important to reorganize cortical network dynamics to a critical state thereby assuring optimal computational capabilities for the following time awake.

Hysteresis effects of changing the parameters of noncooperative games.

We adapt the method used by Jaynes to derive the equilibria of statistical physics to instead derive equilibria of bounded rational game theory. We analyze the dependence of these equilibria on the parameters of the underlying game, focusing on hysteresis effects. In particular, we show that by gradually imposing individual-specific tax rates on the players of the game, and then gradually removing those taxes, the players move from a poor equilibrium to one that is better for all of them.

A geometric approach to complexity.

We develop a geometric approach to complexity based on the principle that complexity requires interactions at different scales of description. Complex systems are more than the sum of their parts of any size and not just more than the sum of their elements. Using information geometry, we therefore analyze the decomposition of a system in terms of an interaction hierarchy. In mathematical terms, we present a theory of complexity measures for finite random fields using the geometric framework of hierarchies of exponential families. Within our framework, previously proposed complexity measures find their natural place and gain a new interpretation.

The sleeping brain as a complex system.

'Complexity science' is a rapidly developing research direction with applications in a multitude of fields that study complex systems consisting of a number of nonlinear elements with interesting dynamics and mutual interactions. This Theme Issue 'The complexity of sleep' aims at fostering the application of complexity science to sleep research, because the brain in its different sleep stages adopts different global states that express distinct activity patterns in large and complex networks of neural circuits. This introduction discusses the contributions collected in the present Theme Issue. We highlight the potential and challenges of a complex systems approach to develop an understanding of the brain in general and the sleeping brain in particular. Basically, we focus on two topics: the complex networks approach to understand the changes in the functional connectivity of the brain during sleep, and the complex dynamics of sleep, including sleep regulation. We hope that this Theme Issue will stimulate and intensify the interdisciplinary communication to advance our understanding of the complex dynamics of the brain that underlies sleep and consciousness.

The multiple time scales of sleep dynamics as a challenge for modelling the sleeping brain.

A particular property of the sleeping brain is that it exhibits dynamics on very different time scales ranging from the typical sleep oscillations such as sleep spindles and slow waves that can be observed in electroencephalogram (EEG) segments of several seconds duration over the transitions between the different sleep stages on a time scale of minutes to the dynamical processes involved in sleep regulation with typical time constants in the range of hours. There is an increasing body of work on mathematical and computational models addressing these different dynamics, however, usually considering only processes on a single time scale. In this paper, we review and present a new analysis of the dynamics of human sleep EEG at the different time scales and relate the findings to recent modelling efforts pointing out both the achievements and remaining challenges.

Robustness of Boolean dynamics under knockouts.

The response to a knockout of a node is a characteristic feature of a networked dynamical system. Knockout resilience in the dynamics of the remaining nodes is a sign of robustness. Here we study the effect of knockouts for binary state sequences and their implementations in terms of Boolean threshold networks. Besides random sequences with biologically plausible constraints, we analyze the cell cycle sequence of the species Saccharomyces cerevisiae and the Boolean networks implementing it. Comparing with an appropriate null model we do not find evidence that the yeast wildtype network is optimized for high knockout resilience. Our notion of knockout resilience weakly correlates with the size of the basin of attraction, which has also been considered a measure of robustness.