A multicolor suite for deciphering population coding of calcium and cAMP in vivo.

cAMP is a universal second messenger regulated by various upstream pathways including Ca2+ and G-protein-coupled receptors (GPCRs). To decipher in vivo cAMP dynamics, we rationally designed cAMPinG1, a sensitive genetically encoded green cAMP indicator that outperformed its predecessors in both dynamic range and cAMP affinity. Two-photon cAMPinG1 imaging detected cAMP transients in the somata and dendritic spines of neurons in the mouse visual cortex on the order of tens of seconds. In addition, multicolor imaging with a sensitive red Ca2+ indicator RCaMP3 allowed simultaneous measurement of population patterns in Ca2+ and cAMP in hundreds of neurons. We found Ca2+-related cAMP responses that represented specific information, such as direction selectivity in vision and locomotion, as well as GPCR-related cAMP responses. Overall, our multicolor suite will facilitate analysis of the interaction between the Ca2+, GPCR and cAMP signaling at single-cell resolution both in vitro and in vivo.

Mechanical actions of dendritic-spine enlargement on presynaptic exocytosis.

Synaptic transmission involves cell-to-cell communication at the synaptic junction between two neurons, and chemical and electrical forms of this process have been extensively studied. In the brain, excitatory glutamatergic synapses are often made on dendritic spines that enlarge during learning1-5. As dendritic spines and the presynaptic terminals are tightly connected with the synaptic cleft6, the enlargement may have mechanical effects on presynaptic functions7. Here we show that fine and transient pushing of the presynaptic boutons with a glass pipette markedly promotes both the evoked release of glutamate and the assembly of SNARE (soluble N-ethylmaleimide-sensitive factor attachment protein receptor) proteins8-12-as measured by Förster resonance transfer (FRET) and fluorescence lifetime imaging-in rat slice culture preparations13. Both of these effects persisted for more than 20 minutes. The increased presynaptic FRET was independent of cytosolic calcium (Ca2+), but dependent on the assembly of SNARE proteins and actin polymerization in the boutons. Notably, a low hypertonic solution of sucrose (20 mM) had facilitatory effects on both the FRET and the evoked release without inducing spontaneous release, in striking contrast with a high hypertonic sucrose solution (300 mM), which induced exocytosis by itself14. Finally, spine enlargement induced by two-photon glutamate uncaging enhanced the evoked release and the FRET only when the spines pushed the boutons by their elongation. Thus, we have identified a mechanosensory and transduction mechanism15 in the presynaptic boutons, in which the evoked release of glutamate is enhanced for more than 20 min.

Spine dynamics in the brain, mental disorders and artificial neural networks.

In the brain, most synapses are formed on minute protrusions known as dendritic spines. Unlike their artificial intelligence counterparts, spines are not merely tuneable memory elements: they also embody algorithms that implement the brain's ability to learn from experience and cope with new challenges. Importantly, they exhibit structural dynamics that depend on activity, excitatory input and inhibitory input (synaptic plasticity or 'extrinsic' dynamics) and dynamics independent of activity ('intrinsic' dynamics), both of which are subject to neuromodulatory influences and reinforcers such as dopamine. Here we succinctly review extrinsic and intrinsic dynamics, compare these with parallels in machine learning where they exist, describe the importance of intrinsic dynamics for memory management and adaptation, and speculate on how disruption of extrinsic and intrinsic dynamics may give rise to mental disorders. Throughout, we also highlight algorithmic features of spine dynamics that may be relevant to future artificial intelligence developments.

Dopamine D2 receptors in discrimination learning and spine enlargement.

Dopamine D2 receptors (D2Rs) are densely expressed in the striatum and have been linked to neuropsychiatric disorders such as schizophrenia1,2. High-affinity binding of dopamine suggests that D2Rs detect transient reductions in dopamine concentration (the dopamine dip) during punishment learning3-5. However, the nature and cellular basis of D2R-dependent behaviour are unclear. Here we show that tone reward conditioning induces marked stimulus generalization in a manner that depends on dopamine D1 receptors (D1Rs) in the nucleus accumbens (NAc) of mice, and that discrimination learning refines the conditioning using a dopamine dip. In NAc slices, a narrow dopamine dip (as short as 0.4 s) was detected by D2Rs to disinhibit adenosine A2A receptor (A2AR)-mediated enlargement of dendritic spines in D2R-expressing spiny projection neurons (D2-SPNs). Plasticity-related signalling by Ca2+/calmodulin-dependent protein kinase II and A2ARs in the NAc was required for discrimination learning. By contrast, extinction learning did not involve dopamine dips or D2-SPNs. Treatment with methamphetamine, which dysregulates dopamine signalling, impaired discrimination learning and spine enlargement, and these impairments were reversed by a D2R antagonist. Our data show that D2Rs refine the generalized reward learning mediated by D1Rs.

Slow-rising and fast-falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum.

The greater the reward expectations are, the more different the brain's physiological response will be. Although it is well-documented that better-than-expected outcomes are encoded quantitatively via midbrain dopaminergic (DA) activity, it has been less addressed experimentally whether worse-than-expected outcomes are expressed quantitatively as well. We show that larger reward expectations upon unexpected reward omissions are associated with the preceding slower rise and following larger decrease (DA dip) in the DA concentration at the ventral striatum of mice. We set up a lever press task on a fixed ratio (FR) schedule requiring five lever presses as an effort for a food reward (FR5). The mice occasionally checked the food magazine without a reward before completing the task. The percentage of this premature magazine entry (PME) increased as the number of lever presses approached five, showing rising expectations with increasing proximity to task completion, and hence greater reward expectations. Fibre photometry of extracellular DA dynamics in the ventral striatum using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m ) revealed that the slow increase and fast decrease in DA levels around PMEs were correlated with the PME percentage, demonstrating a monotonic relationship between the DA dip amplitude and degree of expectations. Computational modelling of the lever press task implementing temporal difference errors and state transitions replicated the observed correlation between the PME frequency and DA dip amplitude in the FR5 task. Taken together, these findings indicate that the DA dip amplitude represents the degree of reward expectations monotonically, which may guide behavioural adjustment.

The critical balance between dopamine D2 receptor and RGS for the sensitive detection of a transient decay in dopamine signal.

In behavioral learning, reward-related events are encoded into phasic dopamine (DA) signals in the brain. In particular, unexpected reward omission leads to a phasic decrease in DA (DA dip) in the striatum, which triggers long-term potentiation (LTP) in DA D2 receptor (D2R)-expressing spiny-projection neurons (D2 SPNs). While this LTP is required for reward discrimination, it is unclear how such a short DA-dip signal (0.5-2 s) is transferred through intracellular signaling to the coincidence detector, adenylate cyclase (AC). In the present study, we built a computational model of D2 signaling to determine conditions for the DA-dip detection. The DA dip can be detected only if the basal DA signal sufficiently inhibits AC, and the DA-dip signal sufficiently disinhibits AC. We found that those two requirements were simultaneously satisfied only if two key molecules, D2R and regulators of G protein signaling (RGS) were balanced within a certain range; this balance has indeed been observed in experimental studies. We also found that high level of RGS was required for the detection of a 0.5-s short DA dip, and the analytical solutions for these requirements confirmed their universality. The imbalance between D2R and RGS is associated with schizophrenia and DYT1 dystonia, both of which are accompanied by abnormal striatal LTP. Our simulations suggest that D2 SPNs in patients with schizophrenia and DYT1 dystonia cannot detect short DA dips. We finally discussed that such psychiatric and movement disorders can be understood in terms of the imbalance between D2R and RGS.

Signaling models for dopamine-dependent temporal contiguity in striatal synaptic plasticity.

Animals remember temporal links between their actions and subsequent rewards. We previously discovered a synaptic mechanism underlying such reward learning in D1 receptor (D1R)-expressing spiny projection neurons (D1 SPN) of the striatum. Dopamine (DA) bursts promote dendritic spine enlargement in a time window of only a few seconds after paired pre- and post-synaptic spiking (pre-post pairing), which is termed as reinforcement plasticity (RP). The previous study has also identified underlying signaling pathways; however, it still remains unclear how the signaling dynamics results in RP. In the present study, we first developed a computational model of signaling dynamics of D1 SPNs. The D1 RP model successfully reproduced experimentally observed protein kinase A (PKA) activity, including its critical time window. In this model, adenylate cyclase type 1 (AC1) in the spines/thin dendrites played a pivotal role as a coincidence detector against pre-post pairing and DA burst. In particular, pre-post pairing (Ca2+ signal) stimulated AC1 with a delay, and the Ca2+-stimulated AC1 was activated by the DA burst for the asymmetric time window. Moreover, the smallness of the spines/thin dendrites is crucial to the short time window for the PKA activity. We then developed a RP model for D2 SPNs, which also predicted the critical time window for RP that depended on the timing of pre-post pairing and phasic DA dip. AC1 worked for the coincidence detector in the D2 RP model as well. We further simulated the signaling pathway leading to Ca2+/calmodulin-dependent protein kinase II (CaMKII) activation and clarified the role of the downstream molecules of AC1 as the integrators that turn transient input signals into persistent spine enlargement. Finally, we discuss how such timing windows guide animals' reward learning.

Labelling and optical erasure of synaptic memory traces in the motor cortex.

Dendritic spines are the major loci of synaptic plasticity and are considered as possible structural correlates of memory. Nonetheless, systematic manipulation of specific subsets of spines in the cortex has been unattainable, and thus, the link between spines and memory has been correlational. We developed a novel synaptic optoprobe, AS-PaRac1 (activated synapse targeting photoactivatable Rac1), that can label recently potentiated spines specifically, and induce the selective shrinkage of AS-PaRac1-containing spines. In vivo imaging of AS-PaRac1 revealed that a motor learning task induced substantial synaptic remodelling in a small subset of neurons. The acquired motor learning was disrupted by the optical shrinkage of the potentiated spines, whereas it was not affected by the identical manipulation of spines evoked by a distinct motor task in the same cortical region. Taken together, our results demonstrate that a newly acquired motor skill depends on the formation of a task-specific dense synaptic ensemble.

Transient and sustained effects of dopamine and serotonin signaling in motivation-related behavior.

Pharmacological studies of antidepressants and atypical antipsychotics have suggested a role of dopamine and serotonin signaling in depression. However, depressive symptoms and treatment effects are difficult to explain based simply on brain-wide decrease or increase in the concentrations of these molecules. Recent animal studies using advanced neuronal manipulation and observation techniques have revealed detailed dopamine and serotonin dynamics that regulate diverse aspects of motivation-related behavior. Dopamine and serotonin transiently modulate moment-to-moment behavior at timescales ranging from sub-second to minutes and also produce persistent effects, such as reward-related learning and stress responses that last longer than several days. Transient and sustained effects often exhibit specific roles depending on the projection sites, where distinct synaptic and cellular mechanisms are required to process the neurotransmitters for each transient and sustained timescale. Therefore, it appears that specific aspects of motivation-related behavior are regulated by distinct synaptic and cellular mechanisms in specific brain regions that underlie the transient and sustained effects of dopamine and serotonin signaling. Recent clinical studies have implied that subjects with depressive symptoms show impaired transient and sustained signaling functions; moreover, they exhibit heterogeneity in depressive symptoms and neuronal dysfunction. Depressive symptoms may be explained by the dysfunction of each transient and sustained signaling mechanism, and distinct patterns of impairment in the relevant mechanisms may explain the heterogeneity of symptoms. Thus, detailed understanding of dopamine and serotonin signaling may provide new insight into depressive symptoms.

Neurogenesis-independent mechanisms of MRI-detectable hippocampal volume increase following electroconvulsive stimulation.

Electroconvulsive therapy (ECT) is one of the most effective psychiatric treatments but the underlying mechanisms are still unclear. In vivo human magnetic resonance imaging (MRI) studies have consistently reported ECT-induced transient hippocampal volume increases, and an animal model of ECT (electroconvulsive stimulation: ECS) was shown to increase neurogenesis. However, a causal relationship between neurogenesis and MRI-detectable hippocampal volume increases following ECT has not been verified. In this study, mice were randomly allocated into four groups, each undergoing a different number of ECS sessions (e.g., 0, 3, 6, 9). T2-weighted images were acquired using 11.7-tesla MRI. A whole brain voxel-based morphometry analysis was conducted to identify any ECS-induced brain volume changes. Additionally, a histological examination with super-resolution microscopy was conducted to investigate microstructural changes in the brain regions that showed volume changes following ECS. Furthermore, parallel experiments were performed on X-ray-irradiated mice to investigate the causal relationship between neurogenesis and ECS-related volume changes. As a result, we revealed for the first time that ECS induced MRI-detectable, dose-dependent hippocampal volume increase in mice. Furthermore, increased hippocampal volumes following ECS were seen even in mice lacking neurogenesis, suggesting that neurogenesis is not required for the increase. The comprehensive histological analyses identified an increase in excitatory synaptic density in the ventral CA1 as the major contributor to the observed hippocampal volume increase following ECS. Our findings demonstrate that modification of synaptic structures rather than neurogenesis may be the underlying biological mechanism of ECT/ECS-induced hippocampal volume increase.

Correlations of brain structure with the social behavior of 15q11-13 duplication mice, an animal model of autism.

Duplication of chromosome 15q11-13 has been reported to be one of the most frequent cytogenetic copy number variations in autism spectrum disorder (ASD), and a mouse model of paternal 15q11-13 duplication was generated, termed 15q dup mice. While previous studies have replicated some of the behavioral and brain structural phenotypes of ASD separately, the relationship between brain structure and behavior has rarely been examined. In this study, we performed behavioral experiments related to anxiety and social behaviors and magnetic resonance imaging (MRI) using the same set of 15q dup and wild-type mice. 15q dup mice showed increased anxiety and a tendency toward alterations in social behaviors, as reported previously, as well as variability in terms of sociability. MRI analysis revealed that a lower sociability index was correlated with a smaller gray matter volume in the right medial entorhinal cortex. These results may help to understand how variability in behavioral phenotypes of ASD arises even in individuals with the same genetic background and to determine the individual differences in neurodevelopmental trajectory correlated with specific brain structures that underlie these phenotypes.

Cellular bases for reward-related dopamine actions.

Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.

A reinforcement learning model with choice traces for a progressive ratio schedule.

The progressive ratio (PR) lever-press task serves as a benchmark for assessing goal-oriented motivation. However, a well-recognized limitation of the PR task is that only a single data point, known as the breakpoint, is obtained from an entire session as a barometer of motivation. Because the breakpoint is defined as the final ratio of responses achieved in a PR session, variations in choice behavior during the PR task cannot be captured. We addressed this limitation by constructing four reinforcement learning models: a simple Q-learning model, an asymmetric model with two learning rates, a perseverance model with choice traces, and a perseverance model without learning. These models incorporated three behavioral choices: reinforced and non-reinforced lever presses and void magazine nosepokes, because we noticed that male mice performed frequent magazine nosepokes during PR tasks. The best model was the perseverance model, which predicted a gradual reduction in amplitudes of reward prediction errors (RPEs) upon void magazine nosepokes. We confirmed the prediction experimentally with fiber photometry of extracellular dopamine (DA) dynamics in the ventral striatum of male mice using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m). We verified application of the model by acute intraperitoneal injection of low-dose methamphetamine (METH) before a PR task, which increased the frequency of magazine nosepokes during the PR session without changing the breakpoint. The perseverance model captured behavioral modulation as a result of increased initial action values, which are customarily set to zero and disregarded in reinforcement learning analysis. Our findings suggest that the perseverance model reveals the effects of psychoactive drugs on choice behaviors during PR tasks.

Mesolimbic dopamine release precedes actively sought aversive stimuli in mice.

In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.

"World-Informed" Neuroscience for Diversity and Inclusion: An Organizational Change in Cognitive Sciences.

By nature, humans are "tojisha (participating subjects/player-witnesses)" who encounter an unpredictable real world. An important characteristic of the relationship between the individual brain and the world is that it creates a loop of interaction and mutual formation. However, cognitive sciences have traditionally been based on a model that treats the world as a given constant. We propose incorporating the interaction loop into this model to create "world-informed neuroscience (WIN)". Based on co-productive research with people with minority characteristics that do not match the world, we hypothesize that the tojisha and the world interact in a two-dimensional way of rule-based and story-based. By defining the cognitive process of becoming tojisha in this way, it is possible to contribute to the various issues of the real world and diversity and inclusion through the integration of the humanities and sciences. The critical role of the brain dopamine system as a basis for brain-world interaction and the importance of research on urbanicity and adolescent development as examples of the application of WIN were discussed. The promotion of these studies will require bidirectional translation between human population science and animal cognitive neuroscience. We propose that the social model of disability should be incorporated into cognitive sciences, and that disability-informed innovation is needed to identify how social factors are involved in mismatches that are difficult to visualize. To promote WIN to ultimately contribute to a diverse and inclusive society, co-production of research from the initial stage of research design should be a baseline requirement.

Shared GABA transmission pathology in dopamine agonist- and antagonist-induced dyskinesia.

Dyskinesia is involuntary movement caused by long-term medication with dopamine-related agents: the dopamine agonist 3,4-dihydroxy-L-phenylalanine (L-DOPA) to treat Parkinson's disease (L-DOPA-induced dyskinesia [LID]) or dopamine antagonists to treat schizophrenia (tardive dyskinesia [TD]). However, it remains unknown why distinct types of medications for distinct neuropsychiatric disorders induce similar involuntary movements. Here, we search for a shared structural footprint using magnetic resonance imaging-based macroscopic screening and super-resolution microscopy-based microscopic identification. We identify the enlarged axon terminals of striatal medium spiny neurons in LID and TD model mice. Striatal overexpression of the vesicular gamma-aminobutyric acid transporter (VGAT) is necessary and sufficient for modeling these structural changes; VGAT levels gate the functional and behavioral alterations in dyskinesia models. Our findings indicate that lowered type 2 dopamine receptor signaling with repetitive dopamine fluctuations is a common cause of VGAT overexpression and late-onset dyskinesia formation and that reducing dopamine fluctuation rescues dyskinesia pathology via VGAT downregulation.

A behavioural correlate of the synaptic eligibility trace in the nucleus accumbens.

Reward reinforces the association between a preceding sensorimotor event and its outcome. Reinforcement learning (RL) theory and recent brain slice studies explain the delayed reward action such that synaptic activities triggered by sensorimotor events leave a synaptic eligibility trace for 1 s. The trace produces a sensitive period for reward-related dopamine to induce synaptic plasticity in the nucleus accumbens (NAc). However, the contribution of the synaptic eligibility trace to behaviour remains unclear. Here we examined a reward-sensitive period to brief pure tones with an accurate measurement of an effective timing of water reward in head-fixed Pavlovian conditioning, which depended on the plasticity-related signaling in the NAc. We found that the reward-sensitive period was within 1 s after the pure tone presentation and optogenetically-induced presynaptic activities at the NAc, showing that the short reward-sensitive period was in conformity with the synaptic eligibility trace in the NAc. These findings support the application of the synaptic eligibility trace to construct biologically plausible RL models.

Retrospective chart review-based assessment scale for adverse childhood events and experiences.

Aim: Adverse childhood experiences (ACEs) are highly prevalent in the general population, and their lifelong impact on physical and mental health is profound. In assessing ACEs, it is vital to consider the pathways and modalities by which an individual internalizes events as an adverse experience and its effects on their biological, psychological, and social function. However, conventional assessments of ACEs are inadequate in that they do not comprehensively assess the source of the adverse event and the pathway and mode of its impact on the individual. Methods: This study developed an original scale for ACEs that classifies the source of the event and the pathway and mode of its impact on the individual from a retrospective review of medical charts. We also used this scale to investigate the ACEs in 536 patients with psychiatric disorders (depression, bipolar disorder, and schizophrenia). Results: This scale consisted of 28 items, and its reliability and validity were sufficient. We also found that 45.9% of the patients studied had at least one ACE, ranging from 43.5% to 51.5% for all disorders. Psychological trauma (bullying) from peers was the most common cause at 27.2%. Conclusion: We developed a retrospective chart review-based assessment tool for ACEs which enables the examination of the source of the events of ACEs and the pathways and modalities of their impact on the individual. The frequency of ACEs is high regardless of the type of psychiatric disorder, and horizontal trauma (bullying victimization) is as frequent as vertical trauma (parental maltreatment).

Personalized values in life as point of interaction with the world: Developmental/neurobehavioral basis and implications for psychiatry.

Behavioral neuroscience has dealt with short-term decision making but has not defined either daily or longer-term life actions. The individual brain interacts with the society/world, but where that point of action is and how it interacts has never been an explicit scientific question. Here, we redefine value as an intrapersonal driver of medium- and long-term life actions. Value has the following three aspects. The first is value as a driving force of action, a factor that commits people to take default-mode or intrinsic actions daily and longer term. It consists of value memories based on past experiences, and a sense of values, the source of choosing actions under uncertain circumstances. It is also a multilayered structure of unconscious/automatic and conscious/self-controlled. The second is personalized value, which focuses not only on the value of human beings in general, but on the aspect that is individualized and personalized, which is the foundation of diversity in society. Third, the value is developed through the life course. It is necessary to clarify how values are personalized through the internalization of parent-child, peer, and social experiences through adolescence, a life stage almost neglected in neuroscience. This viewpoint describes the brain and the behavioral basis of adolescence in which the value and its personalization occur, and the importance of this personalized value as a point of interaction between the individual brain and the world. Then the significance of personalized values in psychiatry is discussed, and the concept of values-informed psychiatry is proposed.

Young carers in Japan: Reliability and validity testing of the BBC/University of Nottingham young carers survey questionnaire and prevalence estimation in 5000 adolescents.

Aim: Young carers (YCs) refer to children under the age of 18 who assume responsibilities that would normally be assumed by adults, such as caring for family members in need of care. In recent years, the concept of YCs has been expanding in Japan, and the government has been rapidly implementing strategies to support them. There is a need for a survey scale for YCs that uses standardized methods that can be compared internationally. Method: The BBC/University of Nottingham Survey for estimating the prevalence of YCs and caring activities of United Kingdom adolescents was translated into Japanese, and its reliability and validity were tested with 313 adolescents. Moreover, the prevalence of YCs was estimated in a school-based survey among 5000 adolescents. Results: The Young Carers Scale Japanese version (YCS-J) was acceptably reliable and valid. The original six-factor model for caring activity in the Multidimensional Assessment of Caring Activities Checklist for Young Carers (MACA-YC18) was supported by confirmatory factor analysis. The prevalence of YCs among 5000 adolescents in the Tokyo metropolitan area was estimated to be 7.4%, comparable to that reported in Western countries and in recent surveys in Japan using nonstandardized methods. YCs exhibited significantly higher scores for prosocial behavior and emotional symptoms than non-YCs. Conclusions: The YCS-J, as an internationally comparable instrument, will be useful for understanding the actual situation of YCs in Japan, and to disseminate and implement support through cooperation among education, welfare, and healthcare sectors.