Changes in corticostriatal connectivity during reinforcement learning in humans.

Many computational models assume that reinforcement learning relies on changes in synaptic efficacy between cortical regions representing stimuli and striatal regions involved in response selection, but this assumption has thus far lacked empirical support in humans. We recorded hemodynamic signals with fMRI while participants navigated a virtual maze to find hidden rewards. We fitted a reinforcement-learning algorithm to participants' choice behavior and evaluated the neural activity and the changes in functional connectivity related to trial-by-trial learning variables. Activity in the posterior putamen during choice periods increased progressively during learning. Furthermore, the functional connections between the sensorimotor cortex and the posterior putamen strengthened progressively as participants learned the task. These changes in corticostriatal connectivity differentiated participants who learned the task from those who did not. These findings provide a direct link between changes in corticostriatal connectivity and learning, thereby supporting a central assumption common to several computational models of reinforcement learning.

Improving the spectral resolution and spectral fitting of (1) H MRSI data from human calf muscle by the SPREAD technique.

Proton magnetic resonance spectroscopic imaging ((1) H MRSI) has been used for the in vivo measurement of intramyocellular lipids (IMCLs) in human calf muscle for almost two decades, but the low spectral resolution between extramyocellular lipids (EMCLs) and IMCLs, partially caused by the magnetic field inhomogeneity, has hindered the accuracy of spectral fitting. The purpose of this paper was to enhance the spectral resolution of (1) H MRSI data from human calf muscle using the SPREAD (spectral resolution amelioration by deconvolution) technique and to assess the influence of improved spectral resolution on the accuracy of spectral fitting and on in vivo measurement of IMCLs. We acquired MRI and (1) H MRSI data from calf muscles of three healthy volunteers. We reconstructed spectral lineshapes of the (1) H MRSI data based on field maps and used the lineshapes to deconvolve the measured MRS spectra, thereby eliminating the line broadening caused by field inhomogeneities and improving the spectral resolution of the (1) H MRSI data. We employed Monte Carlo (MC) simulations with 200 noise realizations to measure the variations of spectral fitting parameters and used an F-test to evaluate the significance of the differences of the variations between the spectra before SPREAD and after SPREAD. We also used Cramer-Rao lower bounds (CRLBs) to assess the improvements of spectral fitting after SPREAD. The use of SPREAD enhanced the separation between EMCL and IMCL peaks in (1) H MRSI spectra from human calf muscle. MC simulations and F-tests showed that the use of SPREAD significantly reduced the standard deviations of the estimated IMCL peak areas (p < 10(-8) ), and the CRLBs were strongly reduced (by ~37%).

Multimodal magnetic resonance imaging: The coordinated use of multiple, mutually informative probes to understand brain structure and function.

Differing imaging modalities provide unique channels of information to probe differing aspects of the brain's structural or functional organization. In combination, differing modalities provide complementary and mutually informative data about tissue organization that is more than their sum. We acquired and spatially coregistered data in four MRI modalities--anatomical MRI, functional MRI, diffusion tensor imaging (DTI), and magnetic resonance spectroscopy (MRS)--from 20 healthy adults to understand how interindividual variability in measures from one modality account for variability in measures from other modalities at each voxel of the brain. We detected significant correlations of local volumes with the magnitude of functional activation, suggesting that underlying variation in local volumes contributes to individual variability in functional activation. We also detected significant inverse correlations of NAA (a putative measure of neuronal density and viability) with volumes of white matter in the frontal cortex, with DTI-based measures of tissue organization within the superior longitudinal fasciculus, and with the magnitude of functional activation and default-mode activity during simple visual and motor tasks, indicating that substantial variance in local volumes, white matter organization, and functional activation derives from an underlying variability in the number or density of neurons in those regions. Many of these imaging measures correlated with measures of intellectual ability within differing brain tissues and differing neural systems, demonstrating that the neural determinants of intellectual capacity involve numerous and disparate features of brain tissue organization, a conclusion that could be made with confidence only when imaging the same individuals with multiple MRI modalities.

Techniques for in utero, longitudinal MRI of fetal brain development in baboons at 3T.

Magnetic Resonance Imaging (MRI) is a promising tool for the noninvasive, longitudinal study of developing primate brains. We developed a protocol to scan pregnant baboons serially at 3T for up to 3h per session. This protocol includes procedures for animal preparation, anesthesia, MRI scanning, and post-scan animal care. We applied this protocol to scan 5 baboons multiple times across the latter 70% of gestation-from as early as 56 days post-conceptional age to as late as 185 days (term approximately 180 days). We successfully acquired high-resolution anatomical images and maps of relaxation times (T(1) and T(2)) of the fetal brains at multiple time points across gestation. These images and maps demonstrated the convergence of gray and white matter contrast near term, and furthermore demonstrated that the convergence of contrast is a consequence of the continuous change in relaxation times during fetal brain development. We estimated the rates of decrease of T(1) and T(2) in white matter and gray matter, respectively. In addition, we measured the volumes of fetal brain at different gestational ages and calculated the growth rates of whole brain (0.91+/-0.08 cm(3)/day) and cortical gray matter (0.40+/-0.04 cm(3)/day). We also measured the mean diffusivity in white matter and deep gray matter using diffusion tensor imaging. In conclusion, in utero MRI of fetal baboon brains greatly enhances the use of nonhuman primate models to study fetal brain development longitudinally.

Rapid four-ring birdcage coil analysis: Design optimization for high efficiency, low interference, and improved body loading tolerance.

The Design accuracy of MRI system with dual-tuned four-ring birdcage coils remains challenging due to inter-coil interference that tends to deteriorate signal-to-noise ratio and thus image quality. In this study, we develop an accurate and efficient FEM modeling strategy by optimizing model geometries, meshing density, and boundary conditions in accord with the correlated measurements on test vehicles. By taking full advantages of simulation accuracy and efficiency, we are able to proceed with sensitivity analysis on critical RF characteristics such as resonance pattern, quality factor, coil coupling, and body loading effects, etc., which may further serve as guidelines for coil design optimization.

When it hurts even more: The neural dynamics of pain and interpersonal emotions.

OBJECTIVE: Chronic pain is highly prevalent among patients with mood, anxiety, personality, and somatic symptom disorders; and patients with chronic pain often suffer from persistent interpersonal distress. However, the neural mechanisms underlying this phenomenon and its possible role in the etiology of chronic pain are not yet understood. Based on our Developmental Theory of Centralized/Somatoform Pain, and prior research suggesting the existence of a shared neural system subserving interpersonal emotions and pain, we aimed to identify the neural basis for modulation of pain by feelings of interpersonal rejection and the role of the early interpersonal environment in development of this shared neural system. METHODS: During fMRI scanning, 22 healthy participants received moderately painful thermal stimuli in 3 interpersonal contexts: Acceptance, Rejection, and Reacceptance (modified Cyberball paradigm). Early interpersonal environment was assessed using the Parental Bonding Instrument. RESULTS: Interpersonal context modulated activity in pain neural systems during rejection and during accepting interactions with previously rejecting others. Moreover, the subjective perception of rejection, even when rejection was not occurring, correlated positively with reported pain severity and neural activity in the insula. The magnitude of neural modulation in pain circuits by feelings of rejection was associated with the quality of early interpersonal experience with caregivers. CONCLUSIONS: Results suggest that interpersonal emotions play an important role in the development and functioning of the pain system, supporting our Developmental Theory of predisposition to chronic centralized pain. These findings have direct implications for clinical practice, including the importance of treating interpersonal distress to alleviate pain.

Resting state cerebral blood flow with arterial spin labeling MRI in developing human brains.

The development of brain circuits is coupled with changes in neurovascular coupling, which refers to the close relationship between neural activity and cerebral blood flow (CBF). Studying the characteristics of CBF during resting state in developing brain can be a complementary way to understand the functional connectivity of the developing brain. Arterial spin labeling (ASL), as a noninvasive MR technique, is particularly attractive for studying cerebral perfusion in children and even newborns. We have collected pulsed ASL data in resting state for 47 healthy subjects from young children to adolescence (aged from 6 to 20 years old). In addition to studying the developmental change of static CBF maps during resting state, we also analyzed the CBF time series to reveal the dynamic characteristics of CBF in differing age groups. We used the seed-based correlation analysis to examine the temporal relationship of CBF time series between the selected ROIs and other brain regions. We have shown the developmental patterns in both static CBF maps and dynamic characteristics of CBF. While higher CBF of default mode network (DMN) in all age groups supports that DMN is the prominent active network during the resting state, the CBF connectivity patterns of some typical resting state networks show distinct patterns of metabolic activity during the resting state in the developing brains.

Information Dissemination of Public Health Emergency on Social Networks and Intelligent Computation.

Due to the extensive social influence, public health emergency has attracted great attention in today's society. The booming social network is becoming a main information dissemination platform of those events and caused high concerns in emergency management, among which a good prediction of information dissemination in social networks is necessary for estimating the event's social impacts and making a proper strategy. However, information dissemination is largely affected by complex interactive activities and group behaviors in social network; the existing methods and models are limited to achieve a satisfactory prediction result due to the open changeable social connections and uncertain information processing behaviors. ACP (artificial societies, computational experiments, and parallel execution) provides an effective way to simulate the real situation. In order to obtain better information dissemination prediction in social networks, this paper proposes an intelligent computation method under the framework of TDF (Theory-Data-Feedback) based on ACP simulation system which was successfully applied to the analysis of A (H1N1) Flu emergency.

Morphological features of the neonatal brain following exposure to regional anesthesia during labor and delivery.

INTRODUCTION: Recent animal and human epidemiological studies suggest that early childhood exposure to anesthesia may have adverse effects on brain development. As more than 50% of pregnant women in the United States and one-third in the United Kingdom receive regional anesthesia during labor and delivery, understanding the effects of perinatal anesthesia on postnatal brain development has important public health relevance. METHODS: We used high-resolution magnetic resonance imaging (MRI) to assess the effects of regional anesthesia during labor and delivery as part of a larger study of perinatal exposures on the morphological features of the neonatal brain. We mapped morphological features of the cortical surface in 37 healthy infants, 24 exposed and 13 unexposed to regional anesthesia at delivery, who were scanned within the first 6 weeks of life. RESULTS: Infants exposed to maternal anesthesia compared with unexposed infants had greater local volumes in portions of the frontal and occipital lobes bilaterally and right posterior portion of the cingulate gyrus. Longer durations of exposure to anesthesia correlated positively with local volumes in the occipital lobe. CONCLUSIONS: Anesthesia exposure during labor and delivery was associated with larger volumes in portions of the frontal and occipital lobes and cingulate gyrus in neonates. Longitudinal MRI studies are needed to determine whether these morphological effects of anesthesia persist and what their consequences on cognition and behavior may be.

Automated assessment of the quality of diffusion tensor imaging data using color cast of color-encoded fractional anisotropy images.

Diffusion tensor imaging (DTI) data often suffer from artifacts caused by motion. These artifacts are especially severe in DTI data from infants, and implementing tight quality controls is therefore imperative for DTI studies of infants. Currently, routine procedures for quality assurance of DTI data involve the slice-wise visual inspection of color-encoded, fractional anisotropy (CFA) images. Such procedures often yield inconsistent results across different data sets, across different operators who are examining those data sets, and sometimes even across time when the same operator inspects the same data set on two different occasions. We propose a more consistent, reliable, and effective method to evaluate the quality of CFA images automatically using their color cast, which is calculated on the distribution statistics of the 2D histogram in the color space as defined by the International Commission on Illumination (CIE) on lightness and a and b (LAB) for the color-opponent dimensions (also known as the CIELAB color space) of the images. Experimental results using DTI data acquired from neonates verified that this proposed method is rapid and accurate. The method thus provides a new tool for real-time quality assurance for DTI data.

Neural correlates of reward-based spatial learning in persons with cocaine dependence.

Dysfunctional learning systems are thought to be central to the pathogenesis of and impair recovery from addictions. The functioning of the brain circuits for episodic memory or learning that support goal-directed behavior has not been studied previously in persons with cocaine dependence (CD). Thirteen abstinent CD and 13 healthy participants underwent MRI scanning while performing a task that requires the use of spatial cues to navigate a virtual-reality environment and find monetary rewards, allowing the functional assessment of the brain systems for spatial learning, a form of episodic memory. Whereas both groups performed similarly on the reward-based spatial learning task, we identified disturbances in brain regions involved in learning and reward in CD participants. In particular, CD was associated with impaired functioning of medial temporal lobe (MTL), a brain region that is crucial for spatial learning (and episodic memory) with concomitant recruitment of striatum (which normally participates in stimulus-response, or habit, learning), and prefrontal cortex. CD was also associated with enhanced sensitivity of the ventral striatum to unexpected rewards but not to expected rewards earned during spatial learning. We provide evidence that spatial learning in CD is characterized by disturbances in functioning of an MTL-based system for episodic memory and a striatum-based system for stimulus-response learning and reward. We have found additional abnormalities in distributed cortical regions. Consistent with findings from animal studies, we provide the first evidence in humans describing the disruptive effects of cocaine on the coordinated functioning of multiple neural systems for learning and memory.

Distinct neural circuits subserve interpersonal and non-interpersonal emotions.

Emotions elicited by interpersonal versus non-interpersonal experiences have different effects on neurobiological functioning in both animals and humans. However, the extent to which the brain circuits underlying interpersonal and non-interpersonal emotions are distinct still remains unclear. The goal of our study was to assess whether different neural circuits are implicated in the processing of arousal and valence of interpersonal versus non-interpersonal emotions. During functional magnetic resonance imaging, participants imagined themselves in emotion-eliciting interpersonal or non-interpersonal situations and then rated the arousal and valence of emotions they experienced. We identified (1) separate neural circuits that are implicated in the arousal and valence dimensions of interpersonal versus non-interpersonal emotions, (2) circuits that are implicated in arousal and valence for both types of emotion, and (3) circuits that are responsive to the type of emotion, regardless of the valence or arousal level of the emotion. We found extensive recruitment of limbic (for arousal) and temporal-parietal (for valence) systems associated with processing of specifically interpersonal emotions compared to non-interpersonal ones. The neural bases of interpersonal and non-interpersonal emotions may, therefore, be largely distinct.

A Virtual Radial Arm Maze for the Study of Multiple Memory Systems in a Functional Magnetic Resonance Imaging Environment.

An increasing number of functional brain imaging studies are employing computer-based virtual reality (VR) to study changes in brain activity during the performance of high-level psychological and cognitive tasks. We report the development of a VR radial arm maze that adapts for human use in a scanning environment with the same general experimental design of behavioral tasks as that has been used with remarkable effectiveness for the study of multiple memory systems in rodents. The software platform is independent of specific computer hardware and operating systems, as we aim to provide shared access to this technology by the research community. We hope that doing so will provide greater standardization of software platform and study paradigm that will reduce variability and improve the comparability of findings across studies. We report the details of the design and implementation of this platform and provide information for downloading of the system for demonstration and research applications.

An fMRI study of the brain responses of traumatized mothers to viewing their toddlers during separation and play.

This study tested whether mothers with interpersonal violence-related posttraumatic stress disorder (IPV-PTSD) vs healthy controls (HC) would show greater limbic and less frontocortical activity when viewing young children during separation compared to quiet play. Mothers of 20 children (12-42 months) participated: 11 IPV-PTSD mothers and 9 HC with no PTSD. During fMRI, mothers watched epochs of play and separation from their own and unfamiliar children. The study focused on comparison of PTSD mothers vs HC viewing children in separation vs play, and viewing own vs unfamiliar children in separation. Both groups showed distinct patterns of brain activation in response to viewing children in separation vs play. PTSD mothers showed greater limbic and less frontocortical activity (BA10) than HC. PTSD mothers also reported feeling more stressed than HC when watching own and unfamiliar children during separation. Their self-reported stress was associated with greater limbic and less frontocortical activity. Both groups also showed distinct patterns of brain activation in response to viewing their own vs unfamiliar children during separation. PTSD mothers' may not have access to frontocortical regulation of limbic response upon seeing own and unfamiliar children in separation. This converges with previously reported associations of maternal IPV-PTSD and atypical caregiving behavior following separation.

Neural systems subserving valence and arousal during the experience of induced emotions.

The circumplex model of affect construes all emotions as linear combinations of 2 independent neurophysiological dimensions, valence and arousal. We used functional magnetic resonance imaging to identify the neural networks subserving valence and arousal, and we assessed, in 10 participants, the associations of the BOLD (blood oxygen level-dependent) response, an indirect index of neural activity, with ratings of valence and arousal during the emotional experiences induced by the presentation of evocative sentences. Unpleasant emotional experience was associated with increased BOLD signal intensities in the supplementary motor, anterior midcingulate, right dorsolateral prefrontal, occipito-temporal, inferior parietal, and cerebellar cortices. Highly arousing emotions were associated with increased BOLD signal intensities in the left thalamus, globus pallidus, caudate, parahippocampal gyrus, amygdala, premotor cortex, and cerebellar vermis. Separate analyses using a finite impulse response model confirmed these results and revealed that pleasant emotions engaged an additional network that included the midbrain, ventral striatum, and caudate nucleus, all portions of a reward circuit. These findings suggest the existence of distinct networks subserving the valence and arousal dimensions of emotions, with midline and medial temporal lobe structures mediating arousal and dorsal cortical areas and mesolimbic pathways mediating valence.

A virtual reality-based FMRI study of reward-based spatial learning.

Although temporo-parietal cortices mediate spatial navigation in animals and humans, the neural correlates of reward-based spatial learning are less well known. Twenty-five healthy adults performed a virtual reality fMRI task that required learning to use extra-maze cues to navigate an 8-arm radial maze and find hidden rewards. Searching the maze in the spatial learning condition compared to the control conditions was associated with activation of temporo-parietal regions, albeit not including the hippocampus. The receipt of rewards was associated with activation of the hippocampus in a control condition when using the extra-maze cues for navigation was rendered impossible by randomizing the spatial location of cues. Our novel experimental design allowed us to assess the differential contributions of the hippocampus and other temporo-parietal areas to searching and reward processing during reward-based spatial learning. This translational research will permit parallel studies in animals and humans to establish the functional similarity of learning systems across species; cellular and molecular studies in animals may then inform the effects of manipulations on these systems in humans, and fMRI studies in humans may inform the interpretation and relevance of findings in animals.

Computational and experimental optimization of a double-tuned (1)H/(31)P four-ring birdcage head coil for MRS at 3T.

PURPOSE: To optimize the homogeneity and efficiency of the B(1) magnetic field of a four-ring birdcage head coil that is double-tuned at the Larmor frequencies of both (31)P and (1)H and optimized to acquire magnetic resonance spectroscopy (MRS) data at 3T for the study of infants. MATERIALS AND METHODS: We developed a finite difference time domain (FDTD) tool in-house to iteratively compute and seek the range of geometric and electromagnetic parameters of a dual-tuned, four-ring birdcage coil that would produce the desired resonance patterns, optimize homogeneity of the B(1)-field, and maximize efficiency of the coil. To demonstrate the validity of our computational results, we constructed three RF coils: one dual-tuned coil that was based on the calculated optimized parameters and two single-tuned coils that had dimensions similar to those of the dual-tuned coil, but tuned at the Larmor frequencies of both (31)P and (1)H, respectively. We then tested and compared the performances of the dual-tuned coil and single-tuned coils at both of these frequencies. RESULTS: We found that a dual-tuned, four-ring birdcage coil with a diameter of 180 mm, an inner birdcage length of 100-300 mm, and an outer birdcage length of 25-100 mm produces the desired resonance patterns. For the use of this coil with human infants, optimization of the homogeneity of the B(1) field, combined with improved coil efficiency, yielded a dual-tuned birdcage coil with diameter of 180mm, an inner birdcage length of 150 mm, an outer birdcage length of 25 mm, and corresponding inner and outer capacitances of 17.2 pF and 7.6 pF, respectively. The experimental results from a constructed coil having the same parameters with the modeled coil agreed well with the computational results from the modeled coil. This optimized design overcame the deficiencies of existing dual-tuned, four-ring birdcage coils. CONCLUSION: The homogeneity and efficiency of the B(1) field for (31)P/(1)H dual-tuned, four-ring birdcage coils can be optimized well using our FDTD tool, especially at high static magnetic fields (B(0)).

Study of the development of fetal baboon brain using magnetic resonance imaging at 3 Tesla.

Direct observational data on the development of the brains of human and nonhuman primates is on remarkably scant, and most of our understanding of primate brain development is extrapolated from findings in rodent models. Magnetic resonance imaging (MRI) is a promising tool for the noninvasive, longitudinal study of the developing primate brain. We devised a protocol to scan pregnant baboons serially at 3 T for up to 3 h per session. Seven baboons were scanned 1-6 times, beginning as early as 56 days post-conceptional age, and as late as 185 days (term approximately 185 days). Successful scanning of the fetal baboon required careful animal preparation and anesthesia, in addition to optimization of the scanning protocol. We successfully acquired maps of relaxation times (T(1) and T(2)) and high-resolution anatomical images of the brains of fetal baboons at multiple time points during the course of gestation. These images demonstrated the convergence of gray and white matter contrast near term, and furthermore demonstrated that the loss of contrast at that age is a consequence of the continuous change in relaxation times during fetal brain development. These data furthermore demonstrate that maps of relaxation times have clear advantages over the relaxation time weighted images for the tracking of the changes in brain structure during fetal development. This protocol for in utero MRI of fetal baboon brains will help to advance the use of nonhuman primate models to study fetal brain development longitudinally.