Computational mechanisms of curiosity and goal-directed exploration.

Successful behaviour depends on the right balance between maximising reward and soliciting information about the world. Here, we show how different types of information-gain emerge when casting behaviour as surprise minimisation. We present two distinct mechanisms for goal-directed exploration that express separable profiles of active sampling to reduce uncertainty. 'Hidden state' exploration motivates agents to sample unambiguous observations to accurately infer the (hidden) state of the world. Conversely, 'model parameter' exploration, compels agents to sample outcomes associated with high uncertainty, if they are informative for their representation of the task structure. We illustrate the emergence of these types of information-gain, termed active inference and active learning, and show how these forms of exploration induce distinct patterns of 'Bayes-optimal' behaviour. Our findings provide a computational framework for understanding how distinct levels of uncertainty systematically affect the exploration-exploitation trade-off in decision-making.

A phenomenological model of seizure initiation suggests network structure may explain seizure frequency in idiopathic generalised epilepsy.

We describe a phenomenological model of seizure initiation, consisting of a bistable switch between stable fixed point and stable limit-cycle attractors. We determine a quasi-analytic formula for the exit time problem for our model in the presence of noise. This formula--which we equate to seizure frequency--is then validated numerically, before we extend our study to explore the combined effects of noise and network structure on escape times. Here, we observe that weakly connected networks of 2, 3 and 4 nodes with equivalent first transitive components all have the same asymptotic escape times. We finally extend this work to larger networks, inferred from electroencephalographic recordings from 35 patients with idiopathic generalised epilepsies and 40 controls. Here, we find that network structure in patients correlates with smaller escape times relative to network structures from controls. These initial findings are suggestive that network structure may play an important role in seizure initiation and seizure frequency.