Characterizing unstructured data with the nearest neighbor permutation entropy.

Permutation entropy and its associated frameworks are remarkable examples of physics-inspired techniques adept at processing complex and extensive datasets. Despite substantial progress in developing and applying these tools, their use has been predominantly limited to structured datasets such as time series or images. Here, we introduce the k-nearest neighbor permutation entropy, an innovative extension of the permutation entropy tailored for unstructured data, irrespective of their spatial or temporal configuration and dimensionality. Our approach builds upon nearest neighbor graphs to establish neighborhood relations and uses random walks to extract ordinal patterns and their distribution, thereby defining the k-nearest neighbor permutation entropy. This tool not only adeptly identifies variations in patterns of unstructured data but also does so with a precision that significantly surpasses conventional measures such as spatial autocorrelation. Additionally, it provides a natural approach for incorporating amplitude information and time gaps when analyzing time series or images, thus significantly enhancing its noise resilience and predictive capabilities compared to the usual permutation entropy. Our research substantially expands the applicability of ordinal methods to more general data types, opening promising research avenues for extending the permutation entropy toolkit for unstructured data.

Results for Nonlinear Diffusion Equations with Stochastic Resetting.

In this study, we investigate a nonlinear diffusion process in which particles stochastically reset to their initial positions at a constant rate. The nonlinear diffusion process is modeled using the porous media equation and its extensions, which are nonlinear diffusion equations. We use analytical and numerical calculations to obtain and interpret the probability distribution of the position of the particles and the mean square displacement. These results are further compared and shown to agree with the results of numerical simulations. Our findings show that a system of this kind exhibits non-Gaussian distributions, transient anomalous diffusion (subdiffusion and superdiffusion), and stationary states that simultaneously depend on the nonlinearity and resetting rate.

Complexity of the COVID-19 pandemic in Maringá.

While extensive literature exists on the COVID-19 pandemic at regional and national levels, understanding its dynamics and consequences at the city level remains limited. This study investigates the pandemic in Maringá, a medium-sized city in Brazil's South Region, using data obtained by actively monitoring the disease from March 2020 to June 2022. Despite prompt and robust interventions, COVID-19 cases increased exponentially during the early spread of COVID-19, with a reproduction number lower than that observed during the initial outbreak in Wuhan. Our research demonstrates the remarkable impact of non-pharmaceutical interventions on both mobility and pandemic indicators, particularly during the onset and the most severe phases of the emergency. However, our results suggest that the city's measures were primarily reactive rather than proactive. Maringá faced six waves of cases, with the third and fourth waves being the deadliest, responsible for over two-thirds of all deaths and overwhelming the local healthcare system. Excess mortality during this period exceeded deaths attributed to COVID-19, indicating that the burdened healthcare system may have contributed to increased mortality from other causes. By the end of the fourth wave, nearly three-quarters of the city's population had received two vaccine doses, significantly decreasing deaths despite the surge caused by the Omicron variant. Finally, we compare these findings with the national context and other similarly sized cities, highlighting substantial heterogeneities in the spread and impact of the disease.

Age and market capitalization drive large price variations of cryptocurrencies.

Cryptocurrencies are considered the latest innovation in finance with considerable impact across social, technological, and economic dimensions. This new class of financial assets has also motivated a myriad of scientific investigations focused on understanding their statistical properties, such as the distribution of price returns. However, research so far has only considered Bitcoin or at most a few cryptocurrencies, whilst ignoring that price returns might depend on cryptocurrency age or be influenced by market capitalization. Here, we therefore present a comprehensive investigation of large price variations for more than seven thousand digital currencies and explore whether price returns change with the coming-of-age and growth of the cryptocurrency market. We find that tail distributions of price returns follow power-law functions over the entire history of the considered cryptocurrency portfolio, with typical exponents implying the absence of characteristic scales for price variations in about half of them. Moreover, these tail distributions are asymmetric as positive returns more often display smaller exponents, indicating that large positive price variations are more likely than negative ones. Our results further reveal that changes in the tail exponents are very often simultaneously related to cryptocurrency age and market capitalization or only to age, with only a minority of cryptoassets being affected just by market capitalization or neither of the two quantities. Lastly, we find that the trends in power-law exponents usually point to mixed directions, and that large price variations are likely to become less frequent only in about 28% of the cryptocurrencies as they age and grow in market capitalization.

Effects of shady environments on fish collective behavior.

Despite significant efforts devoted to understanding the underlying complexity and emergence of collective movement in animal groups, the role of different external settings on this type of movement remains largely unexplored. Here, by combining time series analysis and complex network tools, we present an extensive investigation of the effects of shady environments on the behavior of a fish species (Silver Carp Hypophthalmichthys molitrix) within earthen ponds. We find that shade encourages fish residence during daylight hours, but the degree of preference for shade varies substantially among trials and ponds. Silver Carp are much slower and exhibit lower persistence in their speeds when under shade than out of it during daytime and nighttime, with fish displaying the highest persistence degree and speeds at night. Furthermore, our research shows that shade affects fish schooling behavior by reducing their polarization, number of interactions among individuals, and the stability among local neighbors; however, fish keep a higher local degree of order when under shade compared to nighttime positions.

Machine learning partners in criminal networks.

Recent research has shown that criminal networks have complex organizational structures, but whether this can be used to predict static and dynamic properties of criminal networks remains little explored. Here, by combining graph representation learning and machine learning methods, we show that structural properties of political corruption, police intelligence, and money laundering networks can be used to recover missing criminal partnerships, distinguish among different types of criminal and legal associations, as well as predict the total amount of money exchanged among criminal agents, all with outstanding accuracy. We also show that our approach can anticipate future criminal associations during the dynamic growth of corruption networks with significant accuracy. Thus, similar to evidence found at crime scenes, we conclude that structural patterns of criminal networks carry crucial information about illegal activities, which allows machine learning methods to predict missing information and even anticipate future criminal behavior.

Permutation Jensen-Shannon distance: A versatile and fast symbolic tool for complex time-series analysis.

The main motivation of this paper is to introduce the permutation Jensen-Shannon distance, a symbolic tool able to quantify the degree of similarity between two arbitrary time series. This quantifier results from the fusion of two concepts, the Jensen-Shannon divergence and the encoding scheme based on the sequential ordering of the elements in the data series. The versatility and robustness of this ordinal symbolic distance for characterizing and discriminating different dynamics are illustrated through several numerical and experimental applications. Results obtained allow us to be optimistic about its usefulness in the field of complex time-series analysis. Moreover, thanks to its simplicity, low computational cost, wide applicability, and less susceptibility to outliers and artifacts, this ordinal measure can efficiently handle large amounts of data and help to tackle the current big data challenges.

Universality of political corruption networks.

Corruption crimes demand highly coordinated actions among criminal agents to succeed. But research dedicated to corruption networks is still in its infancy and indeed little is known about the properties of these networks. Here we present a comprehensive investigation of corruption networks related to political scandals in Spain and Brazil over nearly three decades. We show that corruption networks of both countries share universal structural and dynamical properties, including similar degree distributions, clustering and assortativity coefficients, modular structure, and a growth process that is marked by the coalescence of network components due to a few recidivist criminals. We propose a simple model that not only reproduces these empirical properties but reveals also that corruption networks operate near a critical recidivism rate below which the network is entirely fragmented and above which it is overly connected. Our research thus indicates that actions focused on decreasing corruption recidivism may substantially mitigate this type of organized crime.

Population density and spreading of COVID-19 in England and Wales.

We investigated daily COVID-19 cases and deaths in the 337 lower tier local authority regions in England and Wales to better understand how the disease propagated over a 15-month period. Population density scaling models revealed residual variance and skewness to be sensitive indicators of the dynamics of propagation. Lockdowns and schools reopening coincided with increased variance indicative of conditions with local impact and country scale heterogeneity. University reopening and December holidays reduced variance indicative of country scale homogenisation which reached a minimum in mid-January 2021. Homogeneous propagation was associated with better correspondence with normally distributed residuals while heterogeneous propagation was more consistent with skewed models. Skewness varied from strongly negative to strongly positive revealing an unappreciated feature of community propagation. Hot spots and super-spreading events are well understood descriptors of regional disease dynamics that would be expected to be associated with positively skewed distributions. Positively skewed behaviour was observed; however, negative skewness indicative of "cold-spots" and "super-isolation" dominated for approximately 8 months during the period of study. In contrast, death metrics showed near constant behaviour in scaling, variance, and skewness metrics over the full period with rural regions preferentially affected, an observation consistent with regional age demographics in England and Wales. Regional positions relative to density scaling laws were remarkably persistent after the first 5-9 days of the available data set. The determinants of this persistent behaviour probably precede the pandemic and remain unchanged.

Commuting network effect on urban wealth scaling.

Urban scaling theory explains the increasing returns to scale of urban wealth indicators by the per capita increase of human interactions within cities. This explanation implicitly assumes urban areas as isolated entities and ignores their interactions. Here we investigate the effects of commuting networks on the gross domestic product (GDP) of urban areas in the US and Brazil. We describe the urban GDP as the output of a production process where population, incoming commuters, and interactions between these quantities are the input variables. This approach significantly refines the description of urban GDP and shows that incoming commuters contribute to wealth creation in urban areas. Our research indicates that changes in urban GDP related to proportionate changes in population and incoming commuters depend on the initial values of these quantities, such that increasing returns to scale are only possible when the product between population and incoming commuters exceeds a well-defined threshold.

ordpy: A Python package for data analysis with permutation entropy and ordinal network methods.

Since Bandt and Pompe's seminal work, permutation entropy has been used in several applications and is now an essential tool for time series analysis. Beyond becoming a popular and successful technique, permutation entropy inspired a framework for mapping time series into symbolic sequences that triggered the development of many other tools, including an approach for creating networks from time series known as ordinal networks. Despite increasing popularity, the computational development of these methods is fragmented, and there were still no efforts focusing on creating a unified software package. Here, we present ordpy (http://github.com/arthurpessa/ordpy), a simple and open-source Python module that implements permutation entropy and several of the principal methods related to Bandt and Pompe's framework to analyze time series and two-dimensional data. In particular, ordpy implements permutation entropy, Tsallis and Rényi permutation entropies, complexity-entropy plane, complexity-entropy curves, missing ordinal patterns, ordinal networks, and missing ordinal transitions for one-dimensional (time series) and two-dimensional (images) data as well as their multiscale generalizations. We review some theoretical aspects of these tools and illustrate the use of ordpy by replicating several literature results.

Association between population distribution and urban GDP scaling.

Urban scaling and Zipf's law are two fundamental paradigms for the science of cities. These laws have mostly been investigated independently and are often perceived as disassociated matters. Here we present a large scale investigation about the connection between these two laws using population and GDP data from almost five thousand consistently-defined cities in 96 countries. We empirically demonstrate that both laws are tied to each other and derive an expression relating the urban scaling and Zipf exponents. This expression captures the average tendency of the empirical relation between both exponents, and simulations yield very similar results to the real data after accounting for random variations. We find that while the vast majority of countries exhibit increasing returns to scale of urban GDP, this effect is less pronounced in countries with fewer small cities and more metropolises (small Zipf exponent) than in countries with a more uneven number of small and large cities (large Zipf exponent). Our research puts forward the idea that urban scaling does not solely emerge from intra-city processes, as population distribution and scaling of urban GDP are correlated to each other.

Mapping images into ordinal networks.

An increasing abstraction has marked some recent investigations in network science. Examples include the development of algorithms that map time series data into networks whose vertices and edges can have different interpretations, beyond the classical idea of parts and interactions of a complex system. These approaches have proven useful for dealing with the growing complexity and volume of diverse data sets. However, the use of such algorithms is mostly limited to one-dimensional data, and there has been little effort towards extending these methods to higher-dimensional data such as images. Here we propose a generalization for the ordinal network algorithm for mapping images into networks. We investigate the emergence of connectivity constraints inherited from the symbolization process used for defining the network nodes and links, which in turn allows us to derive the exact structure of ordinal networks obtained from random images. We illustrate the use of this new algorithm in a series of applications involving randomization of periodic ornaments, images generated by two-dimensional fractional Brownian motion and the Ising model, and a data set of natural textures. These examples show that measures obtained from ordinal networks (such as average shortest path and global node entropy) extract important image properties related to roughness and symmetry, are robust against noise, and can achieve higher accuracy than traditional texture descriptors extracted from gray-level co-occurrence matrices in simple image classification tasks.

Collective dynamics of stock market efficiency.

Summarized by the efficient market hypothesis, the idea that stock prices fully reflect all available information is always confronted with the behavior of real-world markets. While there is plenty of evidence indicating and quantifying the efficiency of stock markets, most studies assume this efficiency to be constant over time so that its dynamical and collective aspects remain poorly understood. Here we define the time-varying efficiency of stock markets by calculating the permutation entropy within sliding time-windows of log-returns of stock market indices. We show that major world stock markets can be hierarchically classified into several groups that display similar long-term efficiency profiles. However, we also show that efficiency ranks and clusters of markets with similar trends are only stable for a few months at a time. We thus propose a network representation of stock markets that aggregates their short-term efficiency patterns into a global and coherent picture. We find this financial network to be strongly entangled while also having a modular structure that consists of two distinct groups of stock markets. Our results suggest that stock market efficiency is a collective phenomenon that can drive its operation at a high level of informational efficiency, but also places the entire system under risk of failure.

Rural-urban scaling of age, mortality, crime and property reveals a loss of expected self-similar behaviour.

The urban scaling hypothesis has improved our understanding of cities; however, rural areas have been neglected. We investigated rural-urban population density scaling in England and Wales using 67 indicators of crime, mortality, property, and age. Most indicators exhibited segmented scaling about a median critical density of 27 people per hectare. Above the critical density, urban regions preferentially attract young adults (25-40 years) and lose older people (> 45 years). Density scale adjusted metrics (DSAMs) were analysed using hierarchical clustering, networks, and self-organizing maps (SOMs) revealing regional differences and an inverse relationship between excess value of property transactions and a range of preventable mortality (e.g. diabetes, suicide, lung cancer). The most striking finding is that age demographics break the expected self-similarity underlying the urban scaling hypothesis. Urban dynamism is fuelled by preferential attraction of young adults and not a fundamental property of total urban population.

City size and the spreading of COVID-19 in Brazil.

The current outbreak of the coronavirus disease 2019 (COVID-19) is an unprecedented example of how fast an infectious disease can spread around the globe (especially in urban areas) and the enormous impact it causes on public health and socio-economic activities. Despite the recent surge of investigations about different aspects of the COVID-19 pandemic, we still know little about the effects of city size on the propagation of this disease in urban areas. Here we investigate how the number of cases and deaths by COVID-19 scale with the population of Brazilian cities. Our results indicate small towns are proportionally more affected by COVID-19 during the initial spread of the disease, such that the cumulative numbers of cases and deaths per capita initially decrease with population size. However, during the long-term course of the pandemic, this urban advantage vanishes and large cities start to exhibit higher incidence of cases and deaths, such that every 1% rise in population is associated with a 0.14% increase in the number of fatalities per capita after about four months since the first two daily deaths. We argue that these patterns may be related to the existence of proportionally more health infrastructure in the largest cities and a lower proportion of older adults in large urban areas. We also find the initial growth rate of cases and deaths to be higher in large cities; however, these growth rates tend to decrease in large cities and to increase in small ones over time.

Learning physical properties of liquid crystals with deep convolutional neural networks.

Machine learning algorithms have been available since the 1990s, but it is much more recently that they have come into use also in the physical sciences. While these algorithms have already proven to be useful in uncovering new properties of materials and in simplifying experimental protocols, their usage in liquid crystals research is still limited. This is surprising because optical imaging techniques are often applied in this line of research, and it is precisely with images that machine learning algorithms have achieved major breakthroughs in recent years. Here we use convolutional neural networks to probe several properties of liquid crystals directly from their optical images and without using manual feature engineering. By optimizing simple architectures, we find that convolutional neural networks can predict physical properties of liquid crystals with exceptional accuracy. We show that these deep neural networks identify liquid crystal phases and predict the order parameter of simulated nematic liquid crystals almost perfectly. We also show that convolutional neural networks identify the pitch length of simulated samples of cholesteric liquid crystals and the sample temperature of an experimental liquid crystal with very high precision.

Characterizing stochastic time series with ordinal networks.

Approaches for mapping time series to networks have become essential tools for dealing with the increasing challenges of characterizing data from complex systems. Among the different algorithms, the recently proposed ordinal networks stand out due to their simplicity and computational efficiency. However, applications of ordinal networks have been mainly focused on time series arising from nonlinear dynamical systems, while basic properties of ordinal networks related to simple stochastic processes remain poorly understood. Here, we investigate several properties of ordinal networks emerging from random time series, noisy periodic signals, fractional Brownian motion, and earthquake magnitude series. For ordinal networks of random series, we present an approach for building the exact form of the adjacency matrix, which in turn is useful for detecting nonrandom behavior in time series and the existence of missing transitions among ordinal patterns. We find that the average value of a local entropy, estimated from transition probabilities among neighboring nodes of ordinal networks, is more robust against noise addition than the standard permutation entropy. We show that ordinal networks can be used for estimating the Hurst exponent of time series with accuracy comparable with state-of-the-art methods. Finally, we argue that ordinal networks can detect sudden changes in Earth's seismic activity caused by large earthquakes.

Effects of changing population or density on urban carbon dioxide emissions.

The question of whether urbanization contributes to increasing carbon dioxide emissions has been mainly investigated via scaling relationships with population or population density. However, these approaches overlook the correlations between population and area, and ignore possible interactions between these quantities. Here, we propose a generalized framework that simultaneously considers the effects of population and area along with possible interactions between these urban metrics. Our results significantly improve the description of emissions and reveal the coupled role between population and density on emissions. These models show that variations in emissions associated with proportionate changes in population or density may not only depend on the magnitude of these changes but also on the initial values of these quantities. For US areas, the larger the city, the higher is the impact of changing its population or density on its emissions; but population changes always have a greater effect on emissions than population density.

Clustering patterns in efficiency and the coming-of-age of the cryptocurrency market.

The efficient market hypothesis has far-reaching implications for financial trading and market stability. Whether or not cryptocurrencies are informationally efficient has therefore been the subject of intense recent investigation. Here, we use permutation entropy and statistical complexity over sliding time-windows of price log returns to quantify the dynamic efficiency of more than four hundred cryptocurrencies. We consider that a cryptocurrency is efficient within a time-window when these two complexity measures are statistically indistinguishable from their values obtained on randomly shuffled data. We find that 37% of the cryptocurrencies in our study stay efficient over 80% of the time, whereas 20% are informationally efficient in less than 20% of the time. Our results also show that the efficiency is not correlated with the market capitalization of the cryptocurrencies. A dynamic analysis of informational efficiency over time reveals clustering patterns in which different cryptocurrencies with similar temporal patterns form four clusters, and moreover, younger currencies in each group appear poised to follow the trend of their 'elders'. The cryptocurrency market thus already shows notable adherence to the efficient market hypothesis, although data also reveals that the coming-of-age of digital currencies is in this regard still very much underway.