Reward inference by primate prefrontal and striatal neurons.

The brain contains multiple yet distinct systems involved in reward prediction. To understand the nature of these processes, we recorded single-unit activity from the lateral prefrontal cortex (LPFC) and the striatum in monkeys performing a reward inference task using an asymmetric reward schedule. We found that neurons both in the LPFC and in the striatum predicted reward values for stimuli that had been previously well experienced with set reward quantities in the asymmetric reward task. Importantly, these LPFC neurons could predict the reward value of a stimulus using transitive inference even when the monkeys had not yet learned the stimulus-reward association directly; whereas these striatal neurons did not show such an ability. Nevertheless, because there were two set amounts of reward (large and small), the selected striatal neurons were able to exclusively infer the reward value (e.g., large) of one novel stimulus from a pair after directly experiencing the alternative stimulus with the other reward value (e.g., small). Our results suggest that although neurons that predict reward value for old stimuli in the LPFC could also do so for new stimuli via transitive inference, those in the striatum could only predict reward for new stimuli via exclusive inference. Moreover, the striatum showed more complex functions than was surmised previously for model-free learning.

Reward prediction based on stimulus categorization in primate lateral prefrontal cortex.

To adapt to changeable or unfamiliar environments, it is important that animals develop strategies for goal-directed behaviors that meet the new challenges. We used a sequential paired-association task with asymmetric reward schedule to investigate how prefrontal neurons integrate multiple already-acquired associations to predict reward. Two types of reward-related neurons were observed in the lateral prefrontal cortex: one type predicted reward independent of physical properties of visual stimuli and the other encoded the reward value specific to a category of stimuli defined by the task requirements. Neurons of the latter type were able to predict reward on the basis of stimuli that had not yet been associated with reward, provided that another stimulus from the same category was paired with reward. The results suggest that prefrontal neurons can represent reward information on the basis of category and propagate this information to category members that have not been linked directly with any experience of reward.

Multimodal cortico-cortical associations induced by fear and sensory conditioning in the guinea pig.

Sensory cortices are defined by responses to physical stimulation in specific modalities. Recently, additional associatively induced responses have been reported for stimuli other than the main specific modality for each cortex in the human and mammalian brain. In this study, to investigate a type of consolidation, associative responses in the guinea pig cortices (auditory, visual, and somatosensory) were simultaneously measured using optical imaging after first- or second-order conditioning comprising foot shock as an aversive stimulus and tone and light as sensory stimuli. Our findings indicated that (1) after the first- and second-order conditioning, associative responses in each cortical area were additionally induced to stimulate the other specific modality; (2) an associative response to sensory conditioning with tone and light was also seen as a change in the response at the neuronal level without behavioral phenomena; and (3) when fear conditioning with light and foot shock was applied before sensory conditioning with tone and light, the associative response to foot shock in the primary visual cortex (V1) was decreased (extinction) compared with the response after the first-order fear conditioning, whereas the associative response was increased (facilitation) for fear conditioning after sensory conditioning. Our results suggest that various types of bottom-up information are consolidated as associative responses induced in the cortices, which are traced repetitively or alternatively by a change in plasticity involving facilitation and extinction in the cortical network. This information-combining process of cortical responses may play a crucial role in the dynamic linking of memory in the brain.

Prototypic seizure activity driven by mature hippocampal fast-spiking interneurons.

A variety of epileptic seizure models have shown that activation of glutamatergic pyramidal cells is usually required for rhythm generation and/or synchronization in hippocampal seizure-like oscillations in vitro. However, it still remains unclear whether GABAergic interneurons may be able to drive the seizure-like oscillations without glutamatergic transmission. Here, we found that electrical stimulation in rat hippocampal CA1 slices induced a putative prototype of seizure-like oscillations ("prototypic afterdischarge," 1.8-3.8 Hz) in mature pyramidal cells and interneurons in the presence of ionotropic glutamate receptor antagonists. The prototypic afterdischarge was abolished by GABA(A) receptor antagonists or gap junction blockers, but not by a metabotropic glutamate receptor antagonist or a GABA(B) receptor antagonist. Gramicidin-perforated patch-clamp and voltage-clamp recordings revealed that pyramidal cells were depolarized and frequently excited directly through excitatory GABAergic transmissions in each cycle of the prototypic afterdischarge. Interneurons that were actively spiking during the prototypic afterdischarge were mostly fast-spiking (FS) interneurons located in the strata oriens and pyramidale. Morphologically, these interneurons that might be "potential seizure drivers" included basket, chandelier, and bistratified cells. Furthermore, they received direct excitatory GABAergic input during the prototypic afterdischarge. The O-LM cells and most of the interneurons in the strata radiatum and lacunosum moleculare were not essential for the generation of prototypic afterdischarge. The GABA-mediated prototypic afterdischarge was observed later than the third postnatal week in the rat hippocampus. Our results suggest that an FS interneuron network alone can drive the prototypic form of electrically induced seizure-like oscillations through their excitatory GABAergic transmissions and presumably through gap junction-mediated communications.

A context-sensitive mechanism in hippocampal CA1 networks.

This paper presents a possible context-sensitive mechanism in a neural network and at single neuron levels based on the experiments of hippocampal CA1 and their theoretical models. First, the spatiotemporal learning rule (STLR, non-Hebbian) and the Hebbian rule (HEBB) are experimentally shown to coexist in dendrite-soma interactions in single hippocampal pyramidal cells of CA1. Second, the functional differences between STLR and HEBB are theoretically shown in pattern separation and pattern completion. Third, the interaction between STLR and HEBB in neural levels is proposed to play an important role in forming a selective context determined by value information, which is related to expected reward and behavioral estimation.

Comparison of Pattern Discrimination Mechanisms of Hebbian and Spatiotemporal Learning Rules in Self-Organization.

The spatiotemporal learning rule (STLR) proposed based on hippocampal neurophysiological experiments is essentially different from the Hebbian learning rule (HEBLR) in terms of the self-organization mechanism. The difference is the self-organization of information from the external world by firing (HEBLR) or not firing (STLR) output neurons. Here, we describe the differences of the self-organization mechanism between the two learning rules by simulating neural network models trained on relatively similar spatiotemporal context information. Comparing the weight distributions after training, the HEBLR shows a unimodal distribution near the training vector, whereas the STLR shows a multimodal distribution. We analyzed the shape of the weight distribution in response to temporal changes in contextual information and found that the HEBLR does not change the shape of the weight distribution for time-varying spatiotemporal contextual information, whereas the STLR is sensitive to slight differences in spatiotemporal contexts and produces a multimodal distribution. These results suggest a critical difference in the dynamic change of synaptic weight distributions between the HEBLR and STLR in contextual learning. They also capture the characteristics of the pattern completion in the HEBLR and the pattern discrimination in the STLR, which adequately explain the self-organization mechanism of contextual information learning.

Physiological properties of Cantor coding-like iterated function system in the hippocampal CA1 network.

Cantor coding provides an information coding scheme for temporal sequences of events. In the hippocampal CA3-CA1 network, Cantor coding-like mechanism was observed in pyramidal neurons and the relationship between input pattern and recorded responses could be described as an iterated function system. However, detailed physiological properties of the system in CA1 remain unclear. Here, we performed a detailed analysis of the properties of the system related to the physiological basis of learning and memory. First, we investigated whether the system could be simply based on a series of on-off responses of excitatory postsynaptic potential (EPSP) amplitudes. We applied a series of three spatially distinct input patterns with similar EPSP peak amplitudes. The membrane responses showed significant differences in spatial clustering properties related to the iterated function system. These results suggest that existence of some factors, which do not simply depend on a series of on-off responses but on spatial patterns in the system. Second, to confirm whether the system is dependent on the interval of sequential input, we applied spatiotemporal sequential inputs at several intervals. The optimal interval was 30 ms, similar to the physiological input from CA3 to CA1. Third, we analyzed the inhibitory network dependency of the system. After GABAA receptor blocker (gabazine) application, quality of code discrimination in the system was lower under subthreshold conditions and higher under suprathreshold conditions. These results suggest that the inhibitory network increase the difference between the responses under sub- and suprathreshold conditions. In summary, Cantor coding-like iterated function system appears to be suitable for information expression in relation to learning and memory in CA1 network.

Strain-dependent embryonic lethality and exaggerated vascular remodeling in heparin cofactor II-deficient mice.

Heparin cofactor II (HCII) specifically inhibits thrombin action at sites of injured arterial wall, and patients with HCII deficiency exhibit advanced atherosclerosis. However, the in vivo effects and the molecular mechanism underlying the action of HCII during vascular remodeling remain elusive. To clarify the role of HCII in vascular remodeling, we generated HCII-deficient mice by gene targeting. In contrast to a previous report, HCII(-/-) mice were embryonically lethal. In HCII(+/-) mice, prominent intimal hyperplasia with increased cellular proliferation was observed after tube cuff and wire vascular injury. The number of protease-activated receptor-1-positive (PAR-1-positive) cells was increased in the thickened vascular wall of HCII(+/-) mice, suggesting enhanced thrombin action in this region. Cuff injury also increased the expression levels of inflammatory cytokines and chemokines in the vascular wall of HCII(+/-) mice. The intimal hyperplasia in HCII(+/-) mice with vascular injury was abrogated by human HCII supplementation. Furthermore, HCII deficiency caused acceleration of aortic plaque formation with increased PAR-1 expression and oxidative stress in apoE-KO mice. These results demonstrate that HCII protects against thrombin-induced remodeling of an injured vascular wall by inhibiting thrombin action and suggest that HCII is potentially therapeutic against atherosclerosis without causing coagulatory disturbance.

Neural correlates of true memory, false memory, and deception.

We used functional magnetic resonance imaging (fMRI) to determine whether neural activity can differentiate between true memory, false memory, and deception. Subjects heard a series of semantically related words and were later asked to make a recognition judgment of old words, semantically related nonstudied words (lures for false recognition), and unrelated new words. They were also asked to make a deceptive response to half of the old and unrelated new words. There were 3 main findings. First, consistent with the notion that executive function supports deception, 2 types of deception (pretending to know and pretending not to know) recruited prefrontal activity. Second, consistent with the sensory reactivation hypothesis, the difference between true recognition and false recognition was found in the left temporoparietal regions probably engaged in the encoding of auditorily presented words. Third, the left prefrontal cortex was activated during pretending to know relative to correct rejection and false recognition, whereas the right anterior hippocampus was activated during false recognition relative to correct rejection and pretending to know. These findings indicate that fMRI can detect the difference in brain activity between deception and false memory despite the fact that subjects respond with "I know" to novel events in both processes.

Recombinant human antithrombin expressed in Chinese hamster ovary cells shows in vivo efficacy on rat DIC model similarly to plasma-derived antithrombin regardless of different N-glycosylation.

Plasma-derived human antithrombin (pAT) is used for the treatments of disseminated intravascular coagulation (DIC) and hereditary antithrombin deficiencies. We expressed recombinant human antithrombin (rAT) in Chinese hamster ovary (CHO) cells. The purified rAT is composed of 55% alpha-isoform and 45% beta-isoform. The structure of the N-linked oligosaccharides of rAT is the same biantennary complex type as previously found in pAT with less sialylated on the non-reducing ends. Most of the oligosaccharides of rAT are fucosylated at the reducing ends of N-acetylglucosamine, while those of pAT are not fucosylated. Despite of the difference in sialylation and fucosylation of the oligosaccharide units, rAT and pAT showed indistinguishable heparin cofactor and progressive activities, and they bound to thrombin in a one-to-one stoichiometric manner. In lipopolysaccharide (LPS)-induced and thromboplastin-induced DIC rat models, rAT reduced fibrinogen and platelet consumption to a similar extent with pAT. In LPS-induced DIC model, both ATs similarly restrained the increase of alanine aminotransferase and aspartate aminotransferase activities. Finally, pharmacokinetic analysis showed that both ATs had similar half-lives in the circulation of normal rats. Together, the present study demonstrated that rAT prepared in CHO cells has potential for a substitute of pAT in therapeutic use.

Reproducing bursting interspike interval statistics of the gustatory cortex.

Cortical neurons in vivo generate highly irregular spike sequences. Recently, it was experimentally found that the local variation of interspike intervals, LV, is nearly constant for every spike sequence for the same neurons. On the contrary, the coefficient of variation, CV, varies over different spike sequences. Here, we first show that these characteristic features are also applicable in bursting spike sequences that are obtained from the rat gustatory cortex. Next, we show that the conventional leaky integrate-and-fire model does not fully account for reproducing these statistical features in data of real bursting spike sequences. We resolve this difficulty by proposing an alternative neuron model which is a reduction of the bursting neuron model involving the persistent sodium current. Our study implies that (1) the characteristic features of CV and LV are the results of the endogenous bursting and (2) the bursting behavior in the gustatory cortex is caused mainly by the persistent sodium current.

Change detection and difference detection of tone duration discrimination.

An event-related potential called mismatch negativity is known to exhibit physiological evidence of sensory memory. Mismatch negativity is believed to represent complicated neuronal mechanisms in a variety of animals and in humans. We employed the auditory oddball paradigm varying sound durations and observed two types of duration mismatch negativity in anesthetized guinea pigs. One was a duration mismatch negativity whose increase in peak amplitude occurred immediately after onset of the stimulus difference in a decrement oddball paradigm. The other exhibited a peak amplitude increase closer to the offset of the longer stimulus in an increment oddball paradigm. These results demonstrated a mechanism to percept the difference of duration change and revealed the importance of the end of a stimulus for this perception.

Plasma levels of heparin cofactor II (HCII) and thrombin-HCII complex in patients with disseminated intravascular coagulation.

Plasma levels of heparin cofactor II (HCII), thrombin-HCII complex (THC), antithrombin (AT), and thrombin-AT complex (TAT) were evaluated in patients with disseminated intravascular coagulation (DIC) associated with several underlying diseases. Plasma levels of AT were significantly reduced in almost all underlying diseases associated with DIC, but the plasma levels of HCII and HCII/AT ratio were significantly reduced only in patients with infections. While the plasma level of TAT was significantly increased in patients with all underlying diseases associated with DIC, the increase of THC was not significant. Plasma levels of AT were significantly reduced in DIC and pre-DIC associated with almost all underlying diseases, but those of HCII were significantly reduced only in DIC and pre-DIC patients with inflammatory diseases. The plasma levels of TAT were significantly increased in DIC, pre-DIC, and non-DIC patients with all underlying diseases, and those of THC were significantly increased in DIC and pre-DIC patients with inflammatory diseases. The plasma levels of THC were not significantly increased in non-DIC patients of any disease group. The decrease of AT may be caused by thrombin generation or inflammatory reaction that occurs in DIC associated with underlying diseases, while the decrease of HCII might be caused by both thrombin generation and inflammatory reaction. Finally, AT inhibits thrombin more strongly than HCII in several underlying diseases associated with DIC except for inflammatory diseases. In inflammatory diseases, HCII might play an important role in preventing the onset of DIC.

Input integration around the dendritic branches in hippocampal dentate granule cells.

Recent studies have shown that the dendrites of several neurons are not simple translators but are crucial facilitators of excitatory postsynaptic potential (EPSP) propagation and summation of synaptic inputs to compensate for inherent voltage attenuation. Granule cells (GCs)are located at the gateway for valuable information arriving at the hippocampus from the entorhinal cortex. However, the underlying mechanisms of information integration along the dendrites of GCs in the hippocampus are still unclear. In this study, we investigated the input integration around dendritic branches of GCs in the rat hippocampus. We applied differential spatiotemporal stimulations to the dendrites using a high-speed glutamate-uncaging laser. Our results showed that when two sites close to and equidistant from a branching point were simultaneously stimulated, a nonlinear summation of EPSPs was observed at the soma. In addition, nonlinear summation (facilitation) depended on the stimulus location and was significantly blocked by the application of a voltage-dependent Ca(2+) channel antagonist. These findings suggest that the nonlinear summation of EPSPs around the dendritic branches of hippocampal GCs is a result of voltage-dependent Ca(2+) channel activation and may play a crucial role in the integration of input information.

Modulation of synaptic plasticity by the coactivation of spatially distinct synaptic inputs in rat hippocampal CA1 apical dendrites.

The phenomenon whereby the relative timing between presynaptic and postsynaptic spiking determines the direction and extent of synaptic changes in a critical temporal window is known as spike timing-dependent synaptic plasticity (STDP). We have previously reported that STDP profiles can be classified into two types depending on their layer-specific location along CA1 pyramidal neuron dendrites in the rat hippocampus, suggesting that there are differences in information processing between the proximal dendrite (PD) and distal dendrite (DD). However, how the different types of information processing interact at different dendritic locations remains unclear. To investigate how the temporal information of inputs to PD influences information processing at DD, PD stimulation was applied while the STDP protocol was simultaneously applied at DDs of CA1 pyramidal neurons. Synaptic plasticity induced by the STDP protocol at DDs was enhanced or depressed depending on the timing of the back-propagating action potentials (bAPs) and the excitatory and inhibitory postsynaptic potentials elicited by PD stimulation. These results suggested that bAPs function as carriers of temporal information of PD inputs to DD. Next, the influence of DD on PD was investigated using the same protocol. Synaptic plasticity at PD was modulated only if the pairing stimuli were applied to elicit coincidental timing of bAP and the excitatory postsynaptic potential. Such coding modulations could provide the basis for a novel learning rule and may be important factors in the integration of spatiotemporal input information in neural networks in the brain.

Fear conditioning induces guinea pig auditory cortex activation by foot shock alone.

The present study used an optical imaging paradigm to investigate plastic changes in the auditory cortex induced by fear conditioning, in which a sound (conditioned stimulus, CS) was paired with an electric foot-shock (unconditioned stimulus, US). We report that, after conditioning, auditory information could be retrieved on the basis of an electric foot-shock alone. Before conditioning, the auditory cortex showed no response to a foot-shock presented in the absence of sound. In contrast, after conditioning, the mere presentation of a foot-shock without any sound succeeded in eliciting activity in the auditory cortex. Additionally, the magnitude of the optical response in the auditory cortex correlated with variation in the electrocardiogram (correlation coefficient: -0.68). The area activated in the auditory cortex, in response to the electric foot-shock, statistically significantly had a larger cross-correlation value for tone response to the CS sound (12 kHz) compared to the non-CS sounds in normal conditioning group. These results suggest that integration of different sensory modalities in the auditory cortex was established by fear conditioning.

Context and the renewal of conditioned taste aversion: the role of rat dorsal hippocampus examined by electrolytic lesion.

An extinguished conditioned response can sometimes be restored. Previous research has shown that this renewal effect depends on the context in which conditioning versus extinction takes place. Here we provide evidence that the dorsal hippocampus is critically involved in the representation of context that underscores the renewal effect. We performed electrolytic lesions in dorsal hippocampus, before or after extinction, in a conditioned taste aversion paradigm with rats. Rats that underwent all conditioning, extinction and testing procedures in the same experimental context showed no renewal during testing in the original context. In contrast, rats that underwent extinction procedures in a different experimental context than the one in which they had acquired the conditioned response, showed a reliable renewal effect during testing in the original context. When electrolytic lesion was performed prior to extinction, the context-dependent renewal effect was disrupted. When electrolytic lesion was undertaken after extinction, we observed a complex pattern of data including the blockage of the conventional renewal effect, and the appearance of an unconventional renewal effect. The implications of these results are discussed with respect to current views on the role of the dorsal hippocampus in processing context information.

Optical imaging of plastic changes induced by fear conditioning in the auditory cortex.

The plastic changes in the auditory cortex induced by a fear conditioning, through pairing a sound (CS) with an electric foot-shock (US), were investigated using an optical recording method with voltage sensitive dye, RH795. In order to investigate the effects of association learning, optical signals in the auditory cortex in response to CS (12 kHz pure tone) and non-CS (4, 8, 16 kHz pure tone) were recorded before and after normal and sham conditioning. As a result, the response area to CS enlarged only in the conditioning group after the conditioning. Additionally, the rise time constant of the auditory response to CS significantly decreased and the relative peak value and the decay time constant of the auditory response to CS significantly increased after the conditioning. This study introduces an optical approach to the investigation of fear conditioning, representational plasticity, and the cholinergic system. The findings are synthesized in a model of the synaptic mechanisms that underlie cortical plasticity.

Spatiotemporal characteristics of synaptic EPSP summation on the dendritic trees of hippocampal CA1 pyramidal neurons as revealed by laser uncaging stimulation.

Synaptic strength is modified by the temporal coincidence of synaptic inputs without back-propagating action potentials (BPAPs) in CA1 pyramidal neurons. In order to clarify the interactive mechanisms of associative long-term potentiation (LTP) without BPAPs, local paired stimuli were applied to the dendrites using high-speed laser uncaging stimulation equipment. When the spatial distance between the paired stimuli was <10 micrometer, nonlinear amplification in excitatory postsynaptic potential summation was observed. In the time window from -20 to 20 ms, supralinear amplification was observed. Supralinear amplification was modulated by antagonist of voltage-gated Na(+)/Ca(2+) channels and NMDA-type glutamate receptors. These results are closely related to the spatiotemporal-characteristics of associative LTP without BPAPs. This study proposes an essential aspect of dendritic information processing.

A mathematical model for Cantor coding in the hippocampus.

Recent studies suggest that the hippocampus is crucial for memory of sequentially organized information. Cantor coding in hippocampal CA1 is theoretically hypothesized to provide a scheme for encoding temporal sequences of events. Here, in order to investigate this Cantor coding in detail, we construct a CA1 network model consisting of conductance-based model neurons. It is assumed that CA3 outputs temporal sequences of spatial patterns to CA1. We examine the dependence of output patterns of CA1 neurons on input time series by taking each output and combining it with an input sequence. It is shown that the output patterns of CA1 were hierarchically clustered in a self-similar manner according to the similarity of input temporal sequences. The population dynamics of the network can be well approximated by a set of contractive affine transformations, which forms a Cantor set. Furthermore, it is shown that the performance of the encoding scheme sensitively depends on the interval of input sequences. The bursting neurons with NMDA synapses are effective for encoding sequential input with long (over 150 ms) intervals while the non-bursting neurons with AMPA synapses are effective for encoding input with short (less than 30 ms) intervals.