Pattern recognition in the nucleation kinetics of non-equilibrium self-assembly.

Inspired by biology's most sophisticated computer, the brain, neural networks constitute a profound reformulation of computational principles1-3. Analogous high-dimensional, highly interconnected computational architectures also arise within information-processing molecular systems inside living cells, such as signal transduction cascades and genetic regulatory networks4-7. Might collective modes analogous to neural computation be found more broadly in other physical and chemical processes, even those that ostensibly play non-information-processing roles? Here we examine nucleation during self-assembly of multicomponent structures, showing that high-dimensional patterns of concentrations can be discriminated and classified in a manner similar to neural network computation. Specifically, we design a set of 917 DNA tiles that can self-assemble in three alternative ways such that competitive nucleation depends sensitively on the extent of colocalization of high-concentration tiles within the three structures. The system was trained in silico to classify a set of 18 grayscale 30 × 30 pixel images into three categories. Experimentally, fluorescence and atomic force microscopy measurements during and after a 150 hour anneal established that all trained images were correctly classified, whereas a test set of image variations probed the robustness of the results. Although slow compared to previous biochemical neural networks, our approach is compact, robust and scalable. Our findings suggest that ubiquitous physical phenomena, such as nucleation, may hold powerful information-processing capabilities when they occur within high-dimensional multicomponent systems.

Closed ecosystems extract energy through self-organized nutrient cycles.

Our planet is a self-sustaining ecosystem powered by light energy from the sun, but roughly closed to matter. Many ecosystems on Earth are also approximately closed to matter and recycle nutrients by self-organizing stable nutrient cycles, e.g., microbial mats, lakes, open ocean gyres. However, existing ecological models do not exhibit the self-organization and dynamical stability widely observed in such planetary-scale ecosystems. Here, we advance a conceptual model that explains the self-organization, stability, and emergent features of closed microbial ecosystems. Our model incorporates the bioenergetics of metabolism into an ecological framework. By studying this model, we uncover a crucial thermodynamic feedback loop that enables metabolically diverse communities to almost always stabilize nutrient cycles. Surprisingly, highly diverse communities self-organize to extract [Formula: see text]10[Formula: see text] of the maximum extractable energy, or [Formula: see text]100 fold more than randomized communities. Further, with increasing diversity, distinct ecosystems show strongly correlated fluxes through nutrient cycles. However, as the driving force from light increases, the fluxes of nutrient cycles become more variable and species-dependent. Our results highlight that self-organization promotes the efficiency and stability of complex ecosystems at extracting energy from the environment, even in the absence of any centralized coordination.

Learning to learn by using nonequilibrium training protocols for adaptable materials.

Evolution in time-varying environments naturally leads to adaptable biological systems that can easily switch functionalities. Advances in the synthesis of environmentally responsive materials therefore open up the possibility of creating a wide range of synthetic materials which can also be trained for adaptability. We consider high-dimensional inverse problems for materials where any particular functionality can be realized by numerous equivalent choices of design parameters. By periodically switching targets in a given design algorithm, we can teach a material to perform incompatible functionalities with minimal changes in design parameters. We exhibit this learning strategy for adaptability in two simulated settings: elastic networks that are designed to switch deformation modes with minimal bond changes and heteropolymers whose folding pathway selections are controlled by a minimal set of monomer affinities. The resulting designs can reveal physical principles, such as nucleation-controlled folding, that enable such adaptability.

Supervised learning through physical changes in a mechanical system.

Mechanical metamaterials are usually designed to show desired responses to prescribed forces. In some applications, the desired force-response relationship is hard to specify exactly, but examples of forces and desired responses are easily available. Here, we propose a framework for supervised learning in thin, creased sheets that learn the desired force-response behavior by physically experiencing training examples and then, crucially, respond correctly (generalize) to previously unseen test forces. During training, we fold the sheet using training forces, prompting local crease stiffnesses to change in proportion to their experienced strain. We find that this learning process reshapes nonlinearities inherent in folding a sheet so as to show the correct response for previously unseen test forces. We show the relationship between training error, test error, and sheet size (model complexity) in learning sheets and compare them to counterparts in machine-learning algorithms. Our framework shows how the rugged energy landscape of disordered mechanical materials can be sculpted to show desired force-response behaviors by a local physical learning process.

Tuning environmental timescales to evolve and maintain generalists.

Natural environments can present diverse challenges, but some genotypes remain fit across many environments. Such "generalists" can be hard to evolve, outcompeted by specialists fitter in any particular environment. Here, inspired by the search for broadly neutralizing antibodies during B cell affinity maturation, we demonstrate that environmental changes on an intermediate timescale can reliably evolve generalists, even when faster or slower environmental changes are unable to do so. We find that changing environments on timescales comparable with evolutionary transients in a population enhance the rate of evolving generalists from specialists, without enhancing the reverse process. The yield of generalists is further increased in more complex dynamic environments, such as a "chirp" of increasing frequency. Our work offers design principles for how nonequilibrium fitness "seascapes" can dynamically funnel populations to genotypes unobtainable in static environments.

Physical Constraints on Epistasis.

Living systems evolve one mutation at a time, but a single mutation can alter the effect of subsequent mutations. The underlying mechanistic determinants of such epistasis are unclear. Here, we demonstrate that the physical dynamics of a biological system can generically constrain epistasis. We analyze models and experimental data on proteins and regulatory networks. In each, we find that if the long-time physical dynamics is dominated by a slow, collective mode, then the dimensionality of mutational effects is reduced. Consequently, epistatic coefficients for different combinations of mutations are no longer independent, even if individually strong. Such epistasis can be summarized as resulting from a global nonlinearity applied to an underlying linear trait, that is, as global epistasis. This constraint, in turn, reduces the ruggedness of the sequence-to-function map. By providing a generic mechanistic origin for experimentally observed global epistasis, our work suggests that slow collective physical modes can make biological systems evolvable.

Roadmap on biology in time varying environments.

Biological organisms experience constantly changing environments, from sudden changes in physiology brought about by feeding, to the regular rising and setting of the Sun, to ecological changes over evolutionary timescales. Living organisms have evolved to thrive in this changing world but the general principles by which organisms shape and are shaped by time varying environments remain elusive. Our understanding is particularly poor in the intermediate regime with no separation of timescales, where the environment changes on the same timescale as the physiological or evolutionary response. Experiments to systematically characterize the response to dynamic environments are challenging since such environments are inherently high dimensional. This roadmap deals with the unique role played by time varying environments in biological phenomena across scales, from physiology to evolution, seeking to emphasize the commonalities and the challenges faced in this emerging area of research.

Nonequilibrium Statistical Mechanics of Continuous Attractors.

Continuous attractors have been used to understand recent neuroscience experiments where persistent activity patterns encode internal representations of external attributes like head direction or spatial location. However, the conditions under which the emergent bump of neural activity in such networks can be manipulated by space and time-dependent external sensory or motor signals are not understood. Here, we find fundamental limits on how rapidly internal representations encoded along continuous attractors can be updated by an external signal. We apply these results to place cell networks to derive a velocity-dependent nonequilibrium memory capacity in neural networks.

Receptor arrays optimized for natural odor statistics.

Natural odors typically consist of many molecules at different concentrations. It is unclear how the numerous odorant molecules and their possible mixtures are discriminated by relatively few olfactory receptors. Using an information theoretic model, we show that a receptor array is optimal for this task if it achieves two possibly conflicting goals: (i) Each receptor should respond to half of all odors and (ii) the response of different receptors should be uncorrelated when averaged over odors presented with natural statistics. We use these design principles to predict statistics of the affinities between receptors and odorant molecules for a broad class of odor statistics. We also show that optimal receptor arrays can be tuned to either resolve concentrations well or distinguish mixtures reliably. Finally, we use our results to predict properties of experimentally measured receptor arrays. Our work can thus be used to better understand natural olfaction, and it also suggests ways to improve artificial sensor arrays.

Information capacity of specific interactions.

Specific interactions are a hallmark feature of self-assembly and signal-processing systems in both synthetic and biological settings. Specificity between components may arise from a wide variety of physical and chemical mechanisms in diverse contexts, from DNA hybridization to shape-sensitive depletion interactions. Despite this diversity, all systems that rely on interaction specificity operate under the constraint that increasing the number of distinct components inevitably increases off-target binding. Here we introduce "capacity," the maximal information encodable using specific interactions, to compare specificity across diverse experimental systems and to compute how specificity changes with physical parameters. Using this framework, we find that "shape" coding of interactions has higher capacity than chemical ("color") coding because the strength of off-target binding is strongly sublinear in binding-site size for shapes while being linear for colors. We also find that different specificity mechanisms, such as shape and color, can be combined in a synergistic manner, giving a capacity greater than the sum of the parts.

Multifarious assembly mixtures: systems allowing retrieval of diverse stored structures.

Self-assembly materials are traditionally designed so that molecular or mesoscale components form a single kind of large structure. Here, we propose a scheme to create "multifarious assembly mixtures," which self-assemble many different large structures from a set of shared components. We show that the number of multifarious structures stored in the solution of components increases rapidly with the number of different types of components. However, each stored structure can be retrieved by tuning only a few parameters, the number of which is only weakly dependent on the size of the assembled structure. Implications for artificial and biological self-assembly are discussed.

Speed, dissipation, and error in kinetic proofreading.

Proofreading mechanisms increase specificity in biochemical reactions by allowing for the dissociation of intermediate complexes. These mechanisms disrupt and reset the reaction to undo errors at the cost of increased time of reaction and free energy expenditure. Here, we draw an analogy between proofreading and microtubule growth which share some of the features described above. Our analogy relates the statistics of growth and shrinkage of microtubules in physical space to the cycling of intermediate complexes in the space of chemical states in proofreading mechanisms. Using this analogy, we find a new kinetic regime of proofreading in which an exponential speed-up of the process can be achieved at the cost of a somewhat larger error rate. This regime is analogous to the transition region between two known growth regimes of microtubules (bounded and unbounded) and is sharply defined in the limit of large proofreading networks. We find that this advantageous regime of speed-error tradeoff might be present in proofreading schemes studied earlier in the charging of tRNA by tRNA synthetases, in RecA filament assembly on ssDNA, and in protein synthesis by ribosomes.

Dynamic coexistence driven by physiological transitions in microbial communities.

Microbial ecosystems are commonly modeled by fixed interactions between species in steady exponential growth states. However, microbes often modify their environments so strongly that they are forced out of the exponential state into stressed or non-growing states. Such dynamics are typical of ecological succession in nature and serial-dilution cycles in the laboratory. Here, we introduce a phenomenological model, the Community State model, to gain insight into the dynamic coexistence of microbes due to changes in their physiological states. Our model bypasses specific interactions (e.g., nutrient starvation, stress, aggregation) that lead to different combinations of physiological states, referred to collectively as "community states", and modeled by specifying the growth preference of each species along a global ecological coordinate, taken here to be the total community biomass density. We identify three key features of such dynamical communities that contrast starkly with steady-state communities: increased tolerance of community diversity to fast growth rates of species dominating different community states, enhanced community stability through staggered dominance of different species in different community states, and increased requirement on growth dominance for the inclusion of late-growing species. These features, derived explicitly for simplified models, are proposed here to be principles aiding the understanding of complex dynamical communities. Our model shifts the focus of ecosystem dynamics from bottom-up studies based on idealized inter-species interaction to top-down studies based on accessible macroscopic observables such as growth rates and total biomass density, enabling quantitative examination of community-wide characteristics.

Dynamic coexistence driven by physiological transitions in microbial communities.

Microbial ecosystems are commonly modeled by fixed interactions between species in steady exponential growth states. However, microbes often modify their environments so strongly that they are forced out of the exponential state into stressed or non-growing states. Such dynamics are typical of ecological succession in nature and serial-dilution cycles in the laboratory. Here, we introduce a phenomenological model, the Community State model, to gain insight into the dynamic coexistence of microbes due to changes in their physiological states. Our model bypasses specific interactions (e.g., nutrient starvation, stress, aggregation) that lead to different combinations of physiological states, referred to collectively as "community states", and modeled by specifying the growth preference of each species along a global ecological coordinate, taken here to be the total community biomass density. We identify three key features of such dynamical communities that contrast starkly with steady-state communities: increased tolerance of community diversity to fast growth rates of species dominating different community states, enhanced community stability through staggered dominance of different species in different community states, and increased requirement on growth dominance for the inclusion of late-growing species. These features, derived explicitly for simplified models, are proposed here to be principles aiding the understanding of complex dynamical communities. Our model shifts the focus of ecosystem dynamics from bottom-up studies based on idealized inter-species interaction to top-down studies based on accessible macroscopic observables such as growth rates and total biomass density, enabling quantitative examination of community-wide characteristics.

A minimal scenario for the origin of non-equilibrium order.

Extant life contains numerous non-equilibrium mechanisms to create order not achievable at equilibrium; it is generally assumed that these mechanisms evolved because the resulting order was sufficiently beneficial to overcome associated costs of time and energy. Here, we identify a broad range of conditions under which non-equilibrium order-creating mechanisms will evolve as an inevitable consequence of self-replication, even if the order is not directly functional. We show that models of polymerases, when expanded to include known stalling effects, can evolve kinetic proofreading through selection for fast replication alone, consistent with data from recent mutational screens. Similarly, replication contingent on fast self-assembly can select for non-equilibrium instabilities and result in more ordered structures without any direct selection for order. We abstract these results into a framework that predicts that self-replication intrinsically amplifies dissipative order-enhancing mechanisms if the distribution of replication times is wide enough. Our work suggests the intriguing possibility that non-equilibrium order can arise more easily than assumed, even before that order is directly functional, with consequences impacting such diverse phenomena as the evolution of mutation rates, kinetic traps in self-assembly, and the origin of life.

Learning to self-fold at a bifurcation.

Disordered mechanical systems can deform along a network of pathways that branch and recombine at special configurations called bifurcation points. Multiple pathways are accessible from these bifurcation points; consequently, computer-aided design algorithms have been sought to achieve a specific structure of pathways at bifurcations by rationally designing the geometry and material properties of these systems. Here, we explore an alternative physical training framework in which the topology of folding pathways in a disordered sheet is changed in a desired manner due to changes in crease stiffnesses induced by prior folding. We study the quality and robustness of such training for different "learning rules," that is, different quantitative ways in which local strain changes the local folding stiffness. We experimentally demonstrate these ideas using sheets with epoxy-filled creases whose stiffnesses change due to folding before the epoxy sets. Our work shows how specific forms of plasticity in materials enable them to learn nonlinear behaviors through their prior deformation history in a robust manner.

Contrastive learning through non-equilibrium memory.

Learning algorithms based on backpropagation have enabled transformative technological advances but alternatives based on local energy-based rules offer benefits in terms of biological plausibility and decentralized training. A broad class of such local learning rules involve \textit{contrasting} a clamped configuration with the free, spontaneous behavior of the system. However, comparisons of clamped and free configurations require explicit memory or switching between Hebbian and anti-Hebbian modes. Here, we show how a simple form of implicit non-equilibrium memory in the update dynamics of each ``synapse'' of a network naturally allows for contrastive learning. During training, free and clamped behaviors are shown in sequence over time using a sawtooth-like temporal protocol that breaks the symmetry between those two behaviors when combined with non-equilibrium update dynamics at each synapse. We show that the needed dynamics is implicit in integral feedback control, broadening the range of physical and biological systems naturally capable of contrastive learning. Finally, we show that non-equilibrium dissipation improves learning quality and determine the Landauer energy cost of contrastive learning through physical dynamics.

Epithelial tissue confinement inhibits cell growth and leads to volume-reducing divisions.

Cell proliferation is a central process in tissue development, homeostasis, and disease, yet how proliferation is regulated in the tissue context remains poorly understood. Here, we introduce a quantitative framework to elucidate how tissue growth dynamics regulate cell proliferation. Using MDCK epithelial monolayers, we show that a limiting rate of tissue expansion creates confinement that suppresses cell growth; however, this confinement does not directly affect the cell cycle. This leads to uncoupling between rates of cell growth and division in epithelia and, thereby, reduces cell volume. Division becomes arrested at a minimal cell volume, which is consistent across diverse epithelia in vivo. Here, the nucleus approaches the minimum volume capable of packaging the genome. Loss of cyclin D1-dependent cell-volume regulation results in an abnormally high nuclear-to-cytoplasmic volume ratio and DNA damage. Overall, we demonstrate how epithelial proliferation is regulated by the interplay between tissue confinement and cell-volume regulation.

Standardized excitable elements for scalable engineering of far-from-equilibrium chemical networks.

Engineered far-from-equilibrium synthetic chemical networks that pulse or switch states in response to environmental signals could precisely regulate the kinetics of chemical synthesis or self-assembly. Currently, such networks must be extensively tuned to compensate for the different activities of and unintended reactions between a network's various chemical components. Modular elements with standardized performance could be used to rapidly construct networks with designed functions. Here we develop standardized excitable chemical regulatory elements, termed genelets, and use them to construct complex in vitro transcriptional networks. We develop a protocol for identifying >15 interchangeable genelet elements with uniform performance and minimal crosstalk. These elements can be combined to engineer feedforward and feedback modules whose dynamics match those predicted by a simple kinetic model. Modules can then be rationally integrated and organized into networks that produce tunable temporal pulses and act as multistate switchable memories. Standardized genelet elements, and the workflow to identify more, should make engineering complex far-from-equilibrium chemical dynamics routine.

Ligand-receptor promiscuity enables cellular addressing.

In multicellular organisms, secreted ligands selectively activate, or "address," specific target cell populations to control cell fate decision-making and other processes. Key cell-cell communication pathways use multiple promiscuously interacting ligands and receptors, provoking the question of how addressing specificity can emerge from molecular promiscuity. To investigate this issue, we developed a general mathematical modeling framework based on the bone morphogenetic protein (BMP) pathway architecture. We find that promiscuously interacting ligand-receptor systems allow a small number of ligands, acting in combinations, to address a larger number of individual cell types, defined by their receptor expression profiles. Promiscuous systems outperform seemingly more specific one-to-one signaling architectures in addressing capability. Combinatorial addressing extends to groups of cell types, is robust to receptor expression noise, grows more powerful with increases in the number of receptor variants, and is maximized by specific biochemical parameter relationships. Together, these results identify design principles governing cellular addressing by ligand combinations.