Approximate information for efficient exploration-exploitation strategies.

This paper addresses the exploration-exploitation dilemma inherent in decision-making, focusing on multiarmed bandit problems. These involve an agent deciding whether to exploit current knowledge for immediate gains or explore new avenues for potential long-term rewards. We here introduce a class of algorithms, approximate information maximization (AIM), which employs a carefully chosen analytical approximation to the gradient of the entropy to choose which arm to pull at each point in time. AIM matches the performance of Thompson sampling, which is known to be asymptotically optimal, as well as that of Infomax from which it derives. AIM thus retains the advantages of Infomax while also offering enhanced computational speed, tractability, and ease of implementation. In particular, we demonstrate how to apply it to a 50-armed bandit game. Its expression is tunable, which allows for specific optimization in various settings, making it possible to surpass the performance of Thompson sampling at short and intermediary times.

Redefining pandemic preparedness: Multidisciplinary insights from the CERP modelling workshop in infectious diseases, workshop report.

In July 2023, the Center of Excellence in Respiratory Pathogens organized a two-day workshop on infectious diseases modelling and the lessons learnt from the Covid-19 pandemic. This report summarizes the rich discussions that occurred during the workshop. The workshop participants discussed multisource data integration and highlighted the benefits of combining traditional surveillance with more novel data sources like mobility data, social media, and wastewater monitoring. Significant advancements were noted in the development of predictive models, with examples from various countries showcasing the use of machine learning and artificial intelligence in detecting and monitoring disease trends. The role of open collaboration between various stakeholders in modelling was stressed, advocating for the continuation of such partnerships beyond the pandemic. A major gap identified was the absence of a common international framework for data sharing, which is crucial for global pandemic preparedness. Overall, the workshop underscored the need for robust, adaptable modelling frameworks and the integration of different data sources and collaboration across sectors, as key elements in enhancing future pandemic response and preparedness.

Cell migration guided by long-lived spatial memory.

Living cells actively migrate in their environment to perform key biological functions-from unicellular organisms looking for food to single cells such as fibroblasts, leukocytes or cancer cells that can shape, patrol or invade tissues. Cell migration results from complex intracellular processes that enable cell self-propulsion, and has been shown to also integrate various chemical or physical extracellular signals. While it is established that cells can modify their environment by depositing biochemical signals or mechanically remodelling the extracellular matrix, the impact of such self-induced environmental perturbations on cell trajectories at various scales remains unexplored. Here, we show that cells can retrieve their path: by confining motile cells on 1D and 2D micropatterned surfaces, we demonstrate that they leave long-lived physicochemical footprints along their way, which determine their future path. On this basis, we argue that cell trajectories belong to the general class of self-interacting random walks, and show that self-interactions can rule large scale exploration by inducing long-lived ageing, subdiffusion and anomalous first-passage statistics. Altogether, our joint experimental and theoretical approach points to a generic coupling between motile cells and their environment, which endows cells with a spatial memory of their path and can dramatically change their space exploration.