Thyroid hormone remodels cortex to coordinate body-wide metabolism and exploration.

Animals adapt to environmental conditions by modifying the function of their internal organs, including the brain. To be adaptive, alterations in behavior must be coordinated with the functional state of organs throughout the body. Here, we find that thyroid hormone-a regulator of metabolism in many peripheral organs-directly activates cell-type-specific transcriptional programs in the frontal cortex of adult male mice. These programs are enriched for axon-guidance genes in glutamatergic projection neurons, synaptic regulatory genes in both astrocytes and neurons, and pro-myelination factors in oligodendrocytes, suggesting widespread plasticity of cortical circuits. Indeed, whole-cell electrophysiology revealed that thyroid hormone alters excitatory and inhibitory synaptic transmission, an effect that requires thyroid hormone-induced gene regulatory programs in presynaptic neurons. Furthermore, thyroid hormone action in the frontal cortex regulates innate exploratory behaviors and causally promotes exploratory decision-making. Thus, thyroid hormone acts directly on the cerebral cortex in males to coordinate exploratory behaviors with whole-body metabolic state.

Top-down control of hippocampal signal-to-noise by prefrontal long-range inhibition.

Prefrontal cortex (PFC) is postulated to exert "top-down control" on information processing throughout the brain to promote specific behaviors. However, pathways mediating top-down control remain poorly understood. In particular, knowledge about direct prefrontal connections that might facilitate top-down control of hippocampal information processing remains sparse. Here we describe monosynaptic long-range GABAergic projections from PFC to hippocampus. These preferentially inhibit vasoactive intestinal polypeptide-expressing interneurons, which are known to disinhibit hippocampal microcircuits. Indeed, stimulating prefrontal-hippocampal GABAergic projections increases hippocampal feedforward inhibition and reduces hippocampal activity in vivo. The net effect of these actions is to specifically enhance the signal-to-noise ratio for hippocampal encoding of object locations and augment object-induced increases in spatial information. Correspondingly, activating or inhibiting these projections promotes or suppresses object exploration, respectively. Together, these results elucidate a top-down prefrontal pathway in which long-range GABAergic projections target disinhibitory microcircuits, thereby enhancing signals and network dynamics underlying exploratory behavior.

An Amygdala Circuit Mediates Experience-Dependent Momentary Arrests during Exploration.

Exploration of novel environments ensures survival and evolutionary fitness. It is expressed through exploratory bouts and arrests that change dynamically based on experience. Neural circuits mediating exploratory behavior should therefore integrate experience and use it to select the proper behavioral output. Using a spatial exploration assay, we uncovered an experience-dependent increase in momentary arrests in locations where animals arrested previously. Calcium imaging in freely exploring mice revealed a genetically and projection-defined neuronal ensemble in the basolateral amygdala that is active during self-paced behavioral arrests. This ensemble was recruited in an experience-dependent manner, and closed-loop optogenetic manipulation of these neurons revealed that they are sufficient and necessary to drive experience-dependent arrests during exploration. Projection-specific imaging and optogenetic experiments revealed that these arrests are effected by basolateral amygdala neurons projecting to the central amygdala, uncovering an amygdala circuit that mediates momentary arrests in familiar places but not avoidance or anxiety/fear-like behaviors.

Humans flexibly integrate social information despite interindividual differences in reward.

There has been much progress in understanding human social learning, including recent studies integrating social information into the reinforcement learning framework. Yet previous studies often assume identical payoffs between observer and demonstrator, overlooking the diversity of social information in real-world interactions. We address this gap by introducing a socially correlated bandit task that accommodates payoff differences among participants, allowing for the study of social learning under more realistic conditions. Our Social Generalization (SG) model, tested through evolutionary simulations and two online experiments, outperforms existing models by incorporating social information into the generalization process, but treating it as noisier than individual observations. Our findings suggest that human social learning is more flexible than previously believed, with the SG model indicating a potential resource-rational trade-off where social learning partially replaces individual exploration. This research highlights the flexibility of humans' social learning, allowing us to integrate social information from others with different preferences, skills, or goals.

Space wandering in the rodent default mode network.

The default mode network (DMN) is a large-scale brain network known to be suppressed during a wide range of cognitive tasks. However, our comprehension of its role in naturalistic and unconstrained behaviors has remained elusive because most research on the DMN has been conducted within the restrictive confines of MRI scanners. Here, we use multisite GCaMP (a genetically encoded calcium indicator) fiber photometry with simultaneous videography to probe DMN function in awake, freely exploring rats. We examined neural dynamics in three core DMN nodes-the retrosplenial cortex, cingulate cortex, and prelimbic cortex-as well as the anterior insula node of the salience network, and their association with the rats' spatial exploration behaviors. We found that DMN nodes displayed a hierarchical functional organization during spatial exploration, characterized by stronger coupling with each other than with the anterior insula. Crucially, these DMN nodes encoded the kinematics of spatial exploration, including linear and angular velocity. Additionally, we identified latent brain states that encoded distinct patterns of time-varying exploration behaviors and found that higher linear velocity was associated with enhanced DMN activity, heightened synchronization among DMN nodes, and increased anticorrelation between the DMN and anterior insula. Our findings highlight the involvement of the DMN in collectively and dynamically encoding spatial exploration in a real-world setting. Our findings challenge the notion that the DMN is primarily a "task-negative" network disengaged from the external world. By illuminating the DMN's role in naturalistic behaviors, our study underscores the importance of investigating brain network function in ecologically valid contexts.

Disrupted routines anticipate musical exploration.

Understanding and predicting the emergence and evolution of cultural tastes manifested in consumption patterns is of central interest to social scientists, analysts of culture, and purveyors of content. Prior research suggests that taste preferences relate to personality traits, values, shifts in mood, and immigration destination. Understanding everyday patterns of listening and the function music plays in life has remained elusive, however, despite speculation that musical nostalgia may compensate for local disruption. Using more than one hundred million streams of four million songs by tens of thousands of international listeners from a global music service, we show that breaches in personal routine are systematically associated with personal musical exploration. As people visited new cities and countries, their preferences diversified, converging toward their travel destinations. As people experienced the very different disruptions associated with COVID-19 lockdowns, their preferences diversified further. Personal explorations did not tend to veer toward the global listening average, but away from it, toward distinctive regional musical content. Exposure to novel music explored during periods of routine disruption showed a persistent influence on listeners' future consumption patterns. Across all of these settings, musical preference reflected rather than compensated for life's surprises, leaving a lasting legacy on tastes. We explore the relationship between these findings and global patterns of behavior and cultural consumption.

Having multiple selves helps learning agents explore and adapt in complex changing worlds.

Satisfying a variety of conflicting needs in a changing environment is a fundamental challenge for any adaptive agent. Here, we show that designing an agent in a modular fashion as a collection of subagents, each dedicated to a separate need, powerfully enhanced the agent's capacity to satisfy its overall needs. We used the formalism of deep reinforcement learning to investigate a biologically relevant multiobjective task: continually maintaining homeostasis of a set of physiologic variables. We then conducted simulations in a variety of environments and compared how modular agents performed relative to standard monolithic agents (i.e., agents that aimed to satisfy all needs in an integrated manner using a single aggregate measure of success). Simulations revealed that modular agents a) exhibited a form of exploration that was intrinsic and emergent rather than extrinsically imposed; b) were robust to changes in nonstationary environments, and c) scaled gracefully in their ability to maintain homeostasis as the number of conflicting objectives increased. Supporting analysis suggested that the robustness to changing environments and increasing numbers of needs were due to intrinsic exploration and efficiency of representation afforded by the modular architecture. These results suggest that the normative principles by which agents have adapted to complex changing environments may also explain why humans have long been described as consisting of "multiple selves."

Childhood unpredictability and the development of exploration.

Early in development, the process of exploration helps children gather new information that fosters learning about the world. Yet, it is unclear how childhood experiences may influence the way humans approach new learning. What influences decisions to exploit known, familiar options versus trying a novel alternative? We found that childhood unpredictability, characterized by unpredictable caregiving and unstable living environments, was associated with reduced exploratory behavior. This effect holds while controlling for individual differences, including anxiety and stress. Individuals who perceived their childhoods as unpredictable explored less and were instead more likely to repeat previous choices (habitual responding). They were also more sensitive to uncertainty than to potential rewards, even when the familiar options yielded lower rewards. We examined these effects across multiple task contexts and via both in-person (N = 78) and online replication (N = 84) studies among 10- to 13-y-olds. Results are discussed in terms of the potential cascading effects of unpredictable environments on the development of decision-making and the effects of early experience on subsequent learning.

Acetylcholine and noradrenaline enhance foraging optimality in humans.

Foraging theory prescribes when optimal foragers should leave the current option for more rewarding alternatives. Actual foragers often exploit options longer than prescribed by the theory, but it is unclear how this foraging suboptimality arises. We investigated whether the upregulation of cholinergic, noradrenergic, and dopaminergic systems increases foraging optimality. In a double-blind, between-subject design, participants (N = 160) received placebo, the nicotinic acetylcholine receptor agonist nicotine, a noradrenaline reuptake inhibitor reboxetine, or a preferential dopamine reuptake inhibitor methylphenidate, and played the role of a farmer who collected milk from patches with different yield. Across all groups, participants on average overharvested. While methylphenidate had no effects on this bias, nicotine, and to some extent also reboxetine, significantly reduced deviation from foraging optimality, which resulted in better performance compared to placebo. Concurring with amplified goal-directedness and excluding heuristic explanations, nicotine independently also improved trial initiation and time perception. Our findings elucidate the neurochemical basis of behavioral flexibility and decision optimality and open unique perspectives on psychiatric disorders affecting these functions.

Exploratory Rearing Is Governed by Hypothalamic Melanin-Concentrating Hormone Neurons According to Locus Ceruleus.

Information seeking, such as standing on tiptoes to look around in humans, is observed across animals and helps survival. Its rodent analog-unsupported rearing on hind legs-was a classic model in deciphering neural signals of cognition and is of intense renewed interest in preclinical modeling of neuropsychiatric states. Neural signals and circuits controlling this dedicated decision to seek information remain largely unknown. While studying subsecond timing of spontaneous behavioral acts and activity of melanin-concentrating hormone (MCH) neurons (MNs) in behaving male and female mice, we observed large MN activity spikes that aligned to unsupported rears. Complementary causal, loss and gain of function, analyses revealed specific control of rear frequency and duration by MNs and MCHR1 receptors. Activity in a key stress center of the brain-the locus ceruleus noradrenaline cells-rapidly inhibited MNs and required functional MCH receptors for its endogenous modulation of rearing. By defining a neural module that both tracks and controls rearing, these findings may facilitate further insights into biology of information seeking.

Dopamine and Norepinephrine Differentially Mediate the Exploration-Exploitation Tradeoff.

Dopamine (DA) and norepinephrine (NE) have been repeatedly implicated in neuropsychiatric vulnerability, in part via their roles in mediating the decision-making processes. Although two neuromodulators share a synthesis pathway and are coactivated under states of arousal, they engage in distinct circuits and modulatory roles. However, the specific role of each neuromodulator in decision-making, in particular the exploration-exploitation tradeoff, remains unclear. Revealing how each neuromodulator contributes to exploration-exploitation tradeoff is important in guiding mechanistic hypotheses emerging from computational psychiatric approaches. To understand the differences and overlaps of the roles of these two catecholamine systems in regulating exploration, a direct comparison using the same dynamic decision-making task is needed. Here, we ran male and female mice in a restless two-armed bandit task, which encourages both exploration and exploitation. We systemically administered a nonselective DA antagonist (flupenthixol), a nonselective DA agonist (apomorphine), a NE beta-receptor antagonist (propranolol), and a NE beta-receptor agonist (isoproterenol) and examined changes in exploration within subjects across sessions. We found a bidirectional modulatory effect of dopamine on exploration. Increasing dopamine activity decreased exploration and decreasing dopamine activity increased exploration. The modulatory effect of beta-noradrenergic receptor activity on exploration was mediated by sex. Reinforcement learning model parameters suggested that dopamine modulation affected exploration via decision noise and norepinephrine modulation affected exploration via sensitivity to outcome. Together, these findings suggested that the mechanisms that govern the exploration-exploitation transition are sensitive to changes in both catecholamine functions and revealed differential roles for NE and DA in mediating exploration.

C. elegans foraging as a model for understanding the neuronal basis of decision-making.

Animals have evolved to seek, select, and exploit food sources in their environment. Collectively termed foraging, these ubiquitous behaviors are necessary for animal survival. As a foundation for understanding foraging, behavioral ecologists established early theoretical and mathematical frameworks which have been subsequently refined and supported by field and laboratory studies of foraging animals. These simple models sought to explain how animals decide which strategies to employ when locating food, what food items to consume, and when to explore the environment for new food sources. These foraging decisions involve integration of prior experience with multimodal sensory information about the animal's current environment and internal state. We suggest that the nematode Caenorhabditis elegans is well-suited for a high-resolution analysis of complex goal-oriented behaviors such as foraging. We focus our discussion on behavioral studies highlighting C. elegans foraging on bacteria and summarize what is known about the underlying neuronal and molecular pathways. Broadly, we suggest that this simple model system can provide a mechanistic understanding of decision-making and present additional avenues for advancing our understanding of complex behavioral processes.

Individuals with adverse childhood experiences explore less and underweight reward feedback.

Adverse childhood experiences (ACEs) are extreme stressors that lead to negative psychosocial outcomes in adulthood. Nonhuman animals explore less after exposure to early stress. Therefore, in this preregistered study, we hypothesized that reduced exploration following ACEs would also be evident in human adults. Further, we predicted that adults with ACEs, in a foraging task, would adopt a decision-making policy that relies on the most-recent reward feedback, a rational strategy for unstable environments. We analyzed data from 145 adult participants, 47 with four or more ACEs and 98 with fewer than four ACEs. In the foraging task, participants evaluated the trade-off between exploiting a known patch with diminishing rewards and exploring a novel one with a fresh distribution of rewards. Using computational modeling, we quantified the degree to which participants' decisions weighted recent feedback. As predicted, participants with ACEs explored less. However, contrary to our hypothesis, they underweighted recent feedback. These unexpected findings indicate that early adversity may dampen reward sensitivity. Our results may help to identify cognitive mechanisms that link childhood trauma to the onset of psychopathology.

Local production of corticotropin-releasing hormone in prefrontal cortex modulates male-specific novelty exploration.

Neuromodulatory substances can be released from distal afferents for communication between brain structures or produced locally to modulate neighboring circuit elements. Corticotropin-releasing hormone (CRH) from long-range neurons in the hypothalamus projecting to the medial prefrontal cortex (mPFC) has been shown to induce anxiety-like behaviors. However, the role of CRH produced in the mPFC has not been investigated. Here we demonstrate that a specific class of mPFC interneurons that express CRH (CrhINs) releases CRH upon high-frequency stimulation to enhance excitability of layer 2/3 pyramidal cells (L2/3 PCs) expressing the CRH receptors. When stimulated at low frequency, CrhINs release GABA resulting in the inhibition of oxytocin receptor-expressing interneurons (OxtrINs) and L2/3 PCs. Conditional deletion of CRH in mPFC CrhINs and chemogenetic activation of CrhINs have opposite effects on novelty exploration in male but not in female mice, and do not affect anxiety-related behaviors in either males or females. Our data reveal that CRH produced by local interneurons in the mPFC is required for sex-specific novelty exploration and suggest that our understanding of complex behaviors may require knowledge of local and remote neuromodulatory action.

Immobilization of Membrane-Associated Protein Complexes on SERS-Active Nanomaterials for Structural and Dynamic Characterization.

Exploring the structural basis of membrane proteins is significant for a deeper understanding of protein functions. In situ analysis of membrane proteins and their dynamics, however, still challenges conventional techniques. Here we report the first attempt to immobilize membrane protein complexes on surface-enhanced Raman scattering (SERS)-active supports, titanium dioxide-coated silver (Ag@TiO2) nanoparticles. Biocompatible immobilization of microsomal monooxygenase complexes is achieved through lipid fission and fusion. SERS activity of the Ag@TiO2 nanoparticles enables in situ monitoring of protein-protein electron transfer and enzyme catalysis in real time. Through SERS fingerprints of the monooxygenase redox centers, the correlations between these protein-ligand interactions and reactive oxygen species generation are revealed, providing novel insights into the molecular mechanisms underlying monooxygenase-mediated apoptotic regulation. This study offers a novel strategy to explore structure-function relationships of membrane protein complexes and has the potential to advance the development of novel reactive oxygen species-inducing drugs for cancer therapy.

Broadband, High-Reflectivity Dielectric Mirrors at Wafer Scale: Combining Photonic Crystal and Metasurface Architectures for Advanced Lightsails.

Highly ambitious initiatives aspire to propel a miniature spacecraft to a neighboring star within a human generation, leveraging the radiation pressure of lasers for propulsion. One major challenge for this enormous feat is to build a meter-scale, ultralow mass lightsail with broadband reflectivity. In this work, we present the design and fabrication of a lightsail composed of two distinct dielectric layers with photonic crystal/metasurface structure covering a 4" wafer. We achieved broadband reflection of >70% spanning over the full Doppler-shifted laser wavelength range during spacecraft acceleration with a low total mass in the range of a few grams when scaled up to meter size. Furthermore, we find new paths to reliably fabricate these subwavelength structures over macroscopic areas and then systematically characterize their optical performance, confirming their suitability for future lightsail applications. Our innovative device and precise nanofabrication approaches represent a significant leap toward interstellar exploration.

tRigon: an R package and Shiny App for integrative (path-)omics data analysis.

BACKGROUND: Pathomics facilitates automated, reproducible and precise histopathology analysis and morphological phenotyping. Similar to molecular omics, pathomics datasets are high-dimensional, but also face large outlier variability and inherent data missingness, making quick and comprehensible data analysis challenging. To facilitate pathomics data analysis and interpretation as well as support a broad implementation we developed tRigon (Toolbox foR InteGrative (path-)Omics data aNalysis), a Shiny application for fast, comprehensive and reproducible pathomics analysis. RESULTS: tRigon is available via the CRAN repository ( https://cran.r-project.org/web/packages/tRigon ) with its source code available on GitLab ( https://git-ce.rwth-aachen.de/labooratory-ai/trigon ). The tRigon package can be installed locally and its application can be executed from the R console via the command 'tRigon::run_tRigon()'. Alternatively, the application is hosted online and can be accessed at https://labooratory.shinyapps.io/tRigon . We show fast computation of small, medium and large datasets in a low- and high-performance hardware setting, indicating broad applicability of tRigon. CONCLUSIONS: tRigon allows researchers without coding abilities to perform exploratory feature analyses of pathomics and non-pathomics datasets on their own using a variety of hardware.

Control-FREEC viewer: a tool for the visualization and exploration of copy number variation data.

BACKGROUND: Copy number alterations (CNAs) are genetic changes commonly found in cancer that involve different regions of the genome and impact cancer progression by affecting gene expression and genomic stability. Computational techniques can analyze copy number data obtained from high-throughput sequencing platforms, and various tools visualize and analyze CNAs in cancer genomes, providing insights into genetic mechanisms driving cancer development and progression. However, tools for visualizing copy number data in cancer research have some limitations. In fact, they can be complex to use and require expertise in bioinformatics or computational biology. While copy number data analysis and visualization provide insights into cancer biology, interpreting results can be challenging, and there may be multiple explanations for observed patterns of copy number alterations. RESULTS: We created Control-FREEC Viewer, a tool that facilitates effective visualization and exploration of copy number data. With Control-FREEC Viewer, experimental data can be easily loaded by the user. After choosing the reference genome, copy number data are displayed in whole genome or single chromosome view. Gain or loss on a specific gene can be found and visualized on each chromosome. Analysis parameters for subsequent sessions can be stored and images can be exported in raster and vector formats. CONCLUSIONS: Control-FREEC Viewer enables users to import and visualize data analyzed by the Control-FREEC tool, as well as by other tools sharing a similar tabular output, providing a comprehensive and intuitive graphical user interface for data visualization.

Wireless monitoring of respiration with EEG reveals relationships between respiration, behavior, and brain activity in freely moving mice.

Active sampling in the olfactory domain is a fundamental aspect of mouse behavior, and there is increasing evidence that respiration-entrained neural activity outside of the olfactory system sets an important global brain rhythm. It is therefore crucial to accurately measure breathing during natural behaviors. We develop a new approach to do this in freely moving animals, by implanting a telemetry-based pressure sensor into the right jugular vein, which allows for wireless monitoring of thoracic pressure. After verifying this technique against standard head-fixed respiration measurements, we combined it with EEG and EMG recording and used evolving partial coherence analysis to investigate the relationship between respiration and brain activity across a range of experiments in which the mice could move freely. During voluntary exploration of odors and objects, we found that the association between respiration and cortical activity in the delta and theta frequency range decreased, whereas the association between respiration and cortical activity in the alpha range increased. During sleep, however, the presentation of an odor was able to cause a transient increase in sniffing without changing dominant sleep rhythms (delta and theta) in the cortex. Our data align with the emerging idea that the respiration rhythm could act as a synchronizing scaffold for specific brain rhythms during wakefulness and exploration, but suggest that respiratory changes are less able to impact brain activity during sleep. Combining wireless respiration monitoring with different types of brain recording across a variety of behaviors will further increase our understanding of the important links between active sampling, passive respiration, and neural activity.NEW & NOTEWORTHY Animals can alter their respiration rate to actively sample their environment, and increasing evidence suggests that neurons across the brain align their firing to this changing rhythm. We developed a new approach to measure sniffing in freely moving mice while simultaneously recording brain activity, and uncovered how specific cortical rhythms changed their coherence with respiration rhythm during natural behaviors and across arousal states.

Regulation of reinforcement learning parameters captures long-term changes in rat behaviour.

In uncertain environments in which resources fluctuate continuously, animals must permanently decide whether to stabilise learning and exploit what they currently believe to be their best option, or instead explore potential alternatives and learn fast from new observations. While such a trade-off has been extensively studied in pretrained animals facing non-stationary decision-making tasks, it is yet unknown how they progressively tune it while learning the task structure during pretraining. Here, we compared the ability of different computational models to account for long-term changes in the behaviour of 24 rats while they learned to choose a rewarded lever in a three-armed bandit task across 24 days of pretraining. We found that the day-by-day evolution of rat performance and win-shift tendency revealed a progressive stabilisation of the way they regulated reinforcement learning parameters. We successfully captured these behavioural adaptations using a meta-learning model in which either the learning rate or the inverse temperature was controlled by the average reward rate.