Deep Active Inference and Scene Construction.

Adaptive agents must act in intrinsically uncertain environments with complex latent structure. Here, we elaborate a model of visual foraging-in a hierarchical context-wherein agents infer a higher-order visual pattern (a "scene") by sequentially sampling ambiguous cues. Inspired by previous models of scene construction-that cast perception and action as consequences of approximate Bayesian inference-we use active inference to simulate decisions of agents categorizing a scene in a hierarchically-structured setting. Under active inference, agents develop probabilistic beliefs about their environment, while actively sampling it to maximize the evidence for their internal generative model. This approximate evidence maximization (i.e., self-evidencing) comprises drives to both maximize rewards and resolve uncertainty about hidden states. This is realized via minimization of a free energy functional of posterior beliefs about both the world as well as the actions used to sample or perturb it, corresponding to perception and action, respectively. We show that active inference, in the context of hierarchical scene construction, gives rise to many empirical evidence accumulation phenomena, such as noise-sensitive reaction times and epistemic saccades. We explain these behaviors in terms of the principled drives that constitute the expected free energy, the key quantity for evaluating policies under active inference. In addition, we report novel behaviors exhibited by these active inference agents that furnish new predictions for research on evidence accumulation and perceptual decision-making. We discuss the implications of this hierarchical active inference scheme for tasks that require planned sequences of information-gathering actions to infer compositional latent structure (such as visual scene construction and sentence comprehension). This work sets the stage for future experiments to investigate active inference in relation to other formulations of evidence accumulation (e.g., drift-diffusion models) in tasks that require planning in uncertain environments with higher-order structure.

Optogenetic activation of short neuropeptide F (sNPF) neurons induces sleep in Drosophila melanogaster.

Sleep abnormalities have widespread and costly public health consequences, yet we have only a rudimentary understanding of the events occurring at the cellular level in the brain that regulate sleep. Several key signaling molecules that regulate sleep across taxa come from the family of neuropeptide transmitters. For example, in Drosophila melanogaster, the neuropeptide Y (NPY)-related transmitter short neuropeptide F (sNPF) appears to promote sleep. In this study, we utilized optogenetic activation of neuronal populations expressing sNPF to determine the causal effects of precisely timed activity in these cells on sleep behavior. Combining sNPF-GAL4 and UAS-Chrimson transgenes allowed us to activate sNPF neurons using red light. We found that activating sNPF neurons for as little as 3 s at a time of day when most flies were awake caused a rapid transition to sleep that persisted for another 2+ hours following the stimulation. Changing the timing of red light stimulation to times of day when flies were already asleep caused the control flies to wake up (due to the pulse of light), but the flies in which sNPF neurons were activated stayed asleep through the light pulse, and then showed further increases in sleep at later points when they would have normally been waking up. Video recording of individual fly responses to short-term (0.5-20 s) activation of sNPF neurons demonstrated a clear light duration-dependent decrease in movement during the subsequent 4-min period. These results provide supportive evidence that sNPF-producing neurons promote long-lasting increases in sleep, and show for the first time that even brief periods of activation of these neurons can cause changes in behavior that persist after cessation of activation. We have also presented evidence that sNPF neuron activation produces a homeostatic sleep drive that can be dissipated at times long after the neurons were stimulated. Future studies will determine the specific roles of sub-populations of sNPF-producing neurons, and will also assess how sNPF neurons act in concert with other neuronal circuits to control sleep.