Gray Matter Volume in Different Cortical Structures Dissociably Relates to Individual Differences in Capacity and Precision of Visual Working Memory.

Visual working memory (VWM) refers to our ability to selectively maintain visual information in a mental representation. While cognitive limits of VWM greatly influence a variety of mental operations, it remains controversial whether the quantity or quality of representations in mind constrains VWM. Here, we examined behavior-to-brain anatomical relations as well as brain activity to brain anatomy associations with a "neural" marker specific to the retention interval of VWM. Our results consistently indicated that individuals who maintained a larger number of items in VWM tended to have a larger gray matter (GM) volume in their left lateral occipital region. In contrast, individuals with a superior ability to retain with high precision tended to have a larger GM volume in their right parietal lobe. These results indicate that individual differences in quantity and quality of VWM may be associated with regional GM volumes in a dissociable manner, indicating willful integration of information in VWM may recruit separable cortical subsystems.

Effective Connectivity from Early Visual Cortex to Posterior Occipitotemporal Face Areas Supports Face Selectivity and Predicts Developmental Prosopagnosia.

Face processing is mediated by interactions between functional areas in the occipital and temporal lobe, and the fusiform face area (FFA) and anterior temporal lobe play key roles in the recognition of facial identity. Individuals with developmental prosopagnosia (DP), a lifelong face recognition impairment, have been shown to have structural and functional neuronal alterations in these areas. The present study investigated how face selectivity is generated in participants with normal face processing, and how functional abnormalities associated with DP, arise as a function of network connectivity. Using functional magnetic resonance imaging and dynamic causal modeling, we examined effective connectivity in normal participants by assessing network models that include early visual cortex (EVC) and face-selective areas and then investigated the integrity of this connectivity in participants with DP. Results showed that a feedforward architecture from EVC to the occipital face area, EVC to FFA, and EVC to posterior superior temporal sulcus (pSTS) best explained how face selectivity arises in both controls and participants with DP. In this architecture, the DP group showed reduced connection strengths on feedforward connections carrying face information from EVC to FFA and EVC to pSTS. These altered network dynamics in DP contribute to the diminished face selectivity in the posterior occipitotemporal areas affected in DP. These findings suggest a novel view on the relevance of feedforward projection from EVC to posterior occipitotemporal face areas in generating cortical face selectivity and differences in face recognition ability. SIGNIFICANCE STATEMENT: Areas of the human brain showing enhanced activation to faces compared to other objects or places have been extensively studied. However, the factors leading to this face selectively have remained mostly unknown. We show that effective connectivity from early visual cortex to posterior occipitotemporal face areas gives rise to face selectivity. Furthermore, people with developmental prosopagnosia, a lifelong face recognition impairment, have reduced face selectivity in the posterior occipitotemporal face areas and left anterior temporal lobe. We show that this reduced face selectivity can be predicted by effective connectivity from early visual cortex to posterior occipitotemporal face areas. This study presents the first network-based account of how face selectivity arises in the human brain.

Causal evidence that intrinsic beta-frequency is relevant for enhanced signal propagation in the motor system as shown through rhythmic TMS.

Correlative evidence provides support for the idea that brain oscillations underpin neural computations. Recent work using rhythmic stimulation techniques in humans provide causal evidence but the interactions of these external signals with intrinsic rhythmicity remain unclear. Here, we show that sensorimotor cortex follows externally applied rhythmic TMS (rTMS) stimulation in the beta-band but that the elicited responses are strongest at the intrinsic individual beta peak frequency. While these entrainment effects are of short duration, even subthreshold rTMS pulses propagate through the network and elicit significant cortico-spinal coupling, particularly when stimulated at the individual beta-frequency. Our results show that externally enforced rhythmicity interacts with intrinsic brain rhythms such that the individual peak frequency determines the effect of rTMS. The observed downstream spinal effect at the resonance frequency provides evidence for the causal role of brain rhythms for signal propagation.

The perception of touch and the ventral somatosensory pathway.

In humans, touching the skin is known to activate, among others, the contralateral primary somatosensory cortex on the postcentral gyrus together with the bilateral parietal operculum (i.e. the anatomical site of the secondary somatosensory cortex). But which brain regions beyond the postcentral gyrus specifically contribute to the perception of touch remains speculative. In this study we collected structural magnetic resonance imaging scans and neurological examination reports of patients with brain injuries or stroke in the left or right hemisphere, but not in the postcentral gyrus as the entry site of cortical somatosensory processing. Using voxel-based lesion-symptom mapping, we compared patients with impaired touch perception (i.e. hypoaesthesia) to patients without such touch impairments. Patients with hypoaesthesia as compared to control patients differed in one single brain cluster comprising the contralateral parietal operculum together with the anterior and posterior insular cortex, the putamen, as well as subcortical white matter connections reaching ventrally towards prefrontal structures. This finding confirms previous speculations on the 'ventral pathway of somatosensory perception' and causally links these brain structures to the perception of touch.

Direct evidence for attention-dependent influences of the frontal eye-fields on feature-responsive visual cortex.

Voluntary selective attention can prioritize different features in a visual scene. The frontal eye-fields (FEF) are one potential source of such feature-specific top-down signals, but causal evidence for influences on visual cortex (as was shown for "spatial" attention) has remained elusive. Here, we show that transcranial magnetic stimulation (TMS) applied to right FEF increased the blood oxygen level-dependent (BOLD) signals in visual areas processing "target feature" but not in "distracter feature"-processing regions. TMS-induced BOLD signals increase in motion-responsive visual cortex (MT+) when motion was attended in a display with moving dots superimposed on face stimuli, but in face-responsive fusiform area (FFA) when faces were attended to. These TMS effects on BOLD signal in both regions were negatively related to performance (on the motion task), supporting the behavioral relevance of this pathway. Our findings provide new causal evidence for the human FEF in the control of nonspatial "feature"-based attention, mediated by dynamic influences on feature-specific visual cortex that vary with the currently attended property.

Spatial attention, precision, and Bayesian inference: a study of saccadic response speed.

Inferring the environment's statistical structure and adapting behavior accordingly is a fundamental modus operandi of the brain. A simple form of this faculty based on spatial attentional orienting can be studied with Posner's location-cueing paradigm in which a cue indicates the target location with a known probability. The present study focuses on a more complex version of this task, where probabilistic context (percentage of cue validity) changes unpredictably over time, thereby creating a volatile environment. Saccadic response speed (RS) was recorded in 15 subjects and used to estimate subject-specific parameters of a Bayesian learning scheme modeling the subjects' trial-by-trial updates of beliefs. Different response models-specifying how computational states translate into observable behavior-were compared using Bayesian model selection. Saccadic RS was most plausibly explained as a function of the precision of the belief about the causes of sensory input. This finding is in accordance with current Bayesian theories of brain function, and specifically with the proposal that spatial attention is mediated by a precision-dependent gain modulation of sensory input. Our results provide empirical support for precision-dependent changes in beliefs about saccade target locations and motivate future neuroimaging and neuropharmacological studies of how Bayesian inference may determine spatial attention.

Visual and audiovisual effects of isochronous timing on visual perception and brain activity.

Understanding how the brain extracts and combines temporal structure (rhythm) information from events presented to different senses remains unresolved. Many neuroimaging beat perception studies have focused on the auditory domain and show the presence of a highly regular beat (isochrony) in "auditory" stimulus streams enhances neural responses in a distributed brain network and affects perceptual performance. Here, we acquired functional magnetic resonance imaging (fMRI) measurements of brain activity while healthy human participants performed a visual task on isochronous versus randomly timed "visual" streams, with or without concurrent task-irrelevant sounds. We found that visual detection of higher intensity oddball targets was better for isochronous than randomly timed streams, extending previous auditory findings to vision. The impact of isochrony on visual target sensitivity correlated positively with fMRI signal changes not only in visual cortex but also in auditory sensory cortex during audiovisual presentations. Visual isochrony activated a similar timing-related brain network to that previously found primarily in auditory beat perception work. Finally, activity in multisensory left posterior superior temporal sulcus increased specifically during concurrent isochronous audiovisual presentations. These results indicate that regular isochronous timing can modulate visual processing and this can also involve multisensory audiovisual brain mechanisms.

Causal evidence for frontal involvement in memory target maintenance by posterior brain areas during distracter interference of visual working memory.

Dorsolateral prefrontal cortex (DLPFC) is recruited during visual working memory (WM) when relevant information must be maintained in the presence of distracting information. The mechanism by which DLPFC might ensure successful maintenance of the contents of WM is, however, unclear; it might enhance neural maintenance of memory targets or suppress processing of distracters. To adjudicate between these possibilities, we applied time-locked transcranial magnetic stimulation (TMS) during functional MRI, an approach that permits causal assessment of a stimulated brain region's influence on connected brain regions, and evaluated how this influence may change under different task conditions. Participants performed a visual WM task requiring retention of visual stimuli (faces or houses) across a delay during which visual distracters could be present or absent. When distracters were present, they were always from the opposite stimulus category, so that targets and distracters were represented in distinct posterior cortical areas. We then measured whether DLPFC-TMS, administered in the delay at the time point when distracters could appear, would modulate posterior regions representing memory targets or distracters. We found that DLPFC-TMS influenced posterior areas only when distracters were present and, critically, that this influence consisted of increased activity in regions representing the current memory targets. DLPFC-TMS did not affect regions representing current distracters. These results provide a new line of causal evidence for a top-down DLPFC-based control mechanism that promotes successful maintenance of relevant information in WM in the presence of distraction.

Plasticity of human auditory-evoked fields induced by shock conditioning and contingency reversal.

We used magnetoencephalography (MEG) to assess plasticity of human auditory cortex induced by classical conditioning and contingency reversal. Participants listened to random sequences of high or low tones. A first baseline phase presented these without further associations. In phase 2, one of the frequencies (CS(+)) was paired with shock on half its occurrences, whereas the other frequency (CS(-)) was not. In phase 3, the contingency assigning CS(+) and CS(-) was reversed. Conditioned pupil dilation was observed in phase 2 but extinguished in phase 3. MEG revealed that, during phase-2 initial conditioning, the P1m, N1m, and P2m auditory components, measured from sensors over auditory temporal cortex, came to distinguish between CS(+) and CS(-). After contingency reversal in phase 3, the later P2m component rapidly reversed its selectivity (unlike the pupil response) but the earlier P1m did not, whereas N1m showed some new learning but not reversal. These results confirm plasticity of human auditory responses due to classical conditioning, but go further in revealing distinct constraints on different levels of the auditory hierarchy. The later P2m component can reverse affiliation immediately in accord with an updated expectancy after contingency reversal, whereas the earlier auditory components cannot. These findings indicate distinct cognitive and emotional influences on auditory processing.

Deconstructing the architecture of dorsal and ventral attention systems with dynamic causal modeling.

Attentional orientation to a spatial cue and reorientation-after invalid cueing-are mediated by two distinct networks in the human brain. A bilateral dorsal frontoparietal network, comprising the intraparietal sulcus (IPS) and the frontal eye fields (FEF), controls the voluntary deployment of attention and may modulate visual cortex in preparation for upcoming stimulation. In contrast, reorienting attention to invalidly cued targets engages a right-lateralized ventral frontoparietal network comprising the temporoparietal junction (TPJ) and ventral frontal cortex. The present fMRI study investigated the functional architecture of these two attentional systems by characterizing effective connectivity during lateralized orienting and reorienting of attention, respectively. Subjects performed a modified version of Posner's location-cueing paradigm. Dynamic causal modeling (DCM) of regional responses in the dorsal and ventral network, identified in a conventional (SPM) whole-brain analysis, was used to compare different functional architectures. Bayesian model selection showed that top-down connections from left and right IPS to left and right visual cortex, respectively, were modulated by the direction of attention. Moreover, model evidence was highest for a model with directed influences from bilateral IPS to FEF, and reciprocal coupling between right and left FEF. Invalid cueing enhanced forward connections from visual areas to right TPJ, and directed influences from right TPJ to right IPS and IFG (inferior frontal gyrus). These findings shed further light on the functional organization of the dorsal and ventral attentional network and support a context-sensitive lateralization in the top-down (backward) mediation of attentional orienting and the bottom-up (forward) effects of invalid cueing.

Linking pain and the body: neural correlates of visually induced analgesia.

The visual context of seeing the body can reduce the experience of acute pain, producing a multisensory analgesia. Here we investigated the neural correlates of this "visually induced analgesia" using fMRI. We induced acute pain with an infrared laser while human participants looked either at their stimulated right hand or at another object. Behavioral results confirmed the expected analgesic effect of seeing the body, while fMRI results revealed an associated reduction of laser-induced activity in ipsilateral primary somatosensory cortex (SI) and contralateral operculoinsular cortex during the visual context of seeing the body. We further identified two known cortical networks activated by sensory stimulation: (1) a set of brain areas consistently activated by painful stimuli (the so-called "pain matrix"), and (2) an extensive set of posterior brain areas activated by the visual perception of the body ("visual body network"). Connectivity analyses via psychophysiological interactions revealed that the visual context of seeing the body increased effective connectivity (i.e., functional coupling) between posterior parietal nodes of the visual body network and the purported pain matrix. Increased connectivity with these posterior parietal nodes was seen for several pain-related regions, including somatosensory area SII, anterior and posterior insula, and anterior cingulate cortex. These findings suggest that visually induced analgesia does not involve an overall reduction of the cortical response elicited by laser stimulation, but is consequent to the interplay between the brain's pain network and a posterior network for body perception, resulting in modulation of the experience of pain.

'Moving' a paralysed hand: bimanual coupling effect in patients with anosognosia for hemiplegia.

Selective neurological impairments can shed light on different aspects of motor cognition. Brain-damaged patients with anosognosia for hemiplegia deny their motor deficit and believe they can still move the paralysed limb. Here we study, for the first time, if the anomalous subjective experience that their affected hand can still move, may have objective consequences that constrain movement execution with the opposite, intact hand. Using a bimanual motor task, in which anosognosic patients were asked to simultaneously trace out lines with their unaffected hand and circles with their paralysed hand, we found that the trajectories of the intact hand were influenced by the requested movement of the paralysed hand, with the intact hand tending to assume an oval trajectory (bimanual coupling effect). This effect was comparable to that of a group of healthy subjects who actually moved both hands. By contrast, brain-damaged patients with motor neglect or actual hemiplegia but no anosognosia did not show this bimanual constraint. We suggest that anosognosic patients may have intact motor intentionality and planning for the plegic hand. Rather than being merely an inexplicable confabulation, anosognosia for the plegic hand can produce objective constraints on what the intact hand does.

Multisensory interplay reveals crossmodal influences on 'sensory-specific' brain regions, neural responses, and judgments.

Although much traditional sensory research has studied each sensory modality in isolation, there has been a recent explosion of interest in causal interplay between different senses. Various techniques have now identified numerous multisensory convergence zones in the brain. Some convergence may arise surprisingly close to low-level sensory-specific cortex, and some direct connections may exist even between primary sensory cortices. A variety of multisensory phenomena have now been reported in which sensory-specific brain responses and perceptual judgments concerning one sense can be affected by relations with other senses. We survey recent progress in this multisensory field, foregrounding human studies against the background of invasive animal work and highlighting possible underlying mechanisms. These include rapid feedforward integration, possible thalamic influences, and/or feedback from multisensory regions to sensory-specific brain areas. Multisensory interplay is more prevalent than classic modular approaches assumed, and new methods are now available to determine the underlying circuits.

Visual selection and the human frontal eye fields: effects of frontal transcranial magnetic stimulation on partial report analyzed by Bundesen's theory of visual attention.

While the frontal eye fields (FEF) are traditionally associated with eye movements, recent work indicates possible roles in controlling selective visual processing. We applied 10 Hz bursts of transcranial magnetic stimulation (TMS) over left or right human FEF while subjects performed a partial-report task that allowed quantitative estimates of top-down control and other parameters affecting visual performance. Participants selectively reported digits in a relevant color (targets) but not those in an irrelevant color (nontargets) from a brief masked display. A target could appear alone or together with an accompanying item (nontarget or target) in the same or opposite hemifield. Targets were normally identified better when presented with a nontarget than with another target, indicating prioritization of task-relevant targets and thus top-down control. We found this usual pattern of results without TMS, and also with TMS over left FEF. However, during right FEF TMS, the detrimental impact of accompanying distractors increased. Formal analysis in terms of Bundesen's (1990) theory of visual attention confirmed that right FEF TMS diminished the top-down control parameter for both hemifields, indicating an FEF role in top-down selection even for targets defined by the nonspatial property of color. Direct comparison with our previous findings for parietal TMS (Hung et al., 2005) confirmed the distinct role of FEF in top-down control, plus right-hemisphere predominance for this in humans.

A regret-induced status quo bias.

A suboptimal bias toward accepting the status quo option in decision-making is well established behaviorally, but the underlying neural mechanisms are less clear. Behavioral evidence suggests the emotion of regret is higher when errors arise from rejection rather than acceptance of a status quo option. Such asymmetry in the genesis of regret might drive the status quo bias on subsequent decisions, if indeed erroneous status quo rejections have a greater neuronal impact than erroneous status quo acceptances. To test this, we acquired human fMRI data during a difficult perceptual decision task that incorporated a trial-to-trial intrinsic status quo option, with explicit signaling of outcomes (error or correct). Behaviorally, experienced regret was higher after an erroneous status quo rejection compared with acceptance. Anterior insula and medial prefrontal cortex showed increased blood oxygenation level-dependent signal after such status quo rejection errors. In line with our hypothesis, a similar pattern of signal change predicted acceptance of the status quo on a subsequent trial. Thus, our data link a regret-induced status quo bias to error-related activity on the preceding trial.

Attentional selection of location and modality in vision and touch modulates low-frequency activity in associated sensory cortices.

Selective attention allows us to focus on particular sensory modalities and locations. Relatively little is known about how attention to a sensory modality may relate to selection of other features, such as spatial location, in terms of brain oscillations, although it has been proposed that low-frequency modulation (α- and ß-bands) may be key. Here, we investigated how attention to space (left or right) and attention to modality (vision or touch) affect ongoing low-frequency oscillatory brain activity over human sensory cortex. Magnetoencephalography was recorded while participants performed a visual or tactile task. In different blocks, touch or vision was task-relevant, whereas spatial attention was cued to the left or right on each trial. Attending to one or other modality suppressed α-oscillations over the corresponding sensory cortex. Spatial attention led to reduced α-oscillations over both sensorimotor and occipital cortex contralateral to the attended location in the cue-target interval, when either modality was task-relevant. Even modality-selective sensors also showed spatial-attention effects for both modalities. The visual and sensorimotor results were generally highly convergent, yet, although attention effects in occipital cortex were dominant in the α-band, in sensorimotor cortex, these were also clearly present in the ß-band. These results extend previous findings that spatial attention can operate in a multimodal fashion and indicate that attention to space and modality both rely on similar mechanisms that modulate low-frequency oscillations.

Causal implication by rhythmic transcranial magnetic stimulation of alpha frequency in feature-based local vs. global attention.

Although oscillatory activity in the alpha band was traditionally associated with lack of alertness, more recent work has linked it to specific cognitive functions, including visual attention. The emerging method of rhythmic transcranial magnetic stimulation (TMS) allows causal interventional tests for the online impact on performance of TMS administered in short bursts at a particular frequency. TMS bursts at 10 Hz have recently been shown to have an impact on spatial visual attention, but any role in featural attention remains unclear. Here we used rhythmic TMS at 10 Hz to assess the impact on attending to global or local components of a hierarchical Navon-like stimulus (D. Navon (1977) Forest before trees: The precedence of global features in visual perception. Cognit. Psychol., 9, 353), in a paradigm recently used with TMS at other frequencies (V. Romei, J. Driver, P.G. Schyns & G. Thut. (2011) Rhythmic TMS over parietal cortex links distinct brain frequencies to global versus local visual processing. Curr. Biol., 2, 334-337). In separate groups, left or right posterior parietal sites were stimulated at 10 Hz just before presentation of the hierarchical stimulus. Participants had to identify either the local or global component in separate blocks. Right parietal 10 Hz stimulation (vs. sham) significantly impaired global processing without affecting local processing, while left parietal 10 Hz stimulation vs. sham impaired local processing with a minor trend to enhance global processing. These 10 Hz outcomes differed significantly from stimulation at other frequencies (i.e. 5 or 20 Hz) over the same site in other recent work with the same paradigm. These dissociations confirm differential roles of the two hemispheres in local vs. global processing, and reveal a frequency-specific role for stimulation in the alpha band for regulating feature-based visual attention.

Audiovisual synchrony enhances BOLD responses in a brain network including multisensory STS while also enhancing target-detection performance for both modalities.

The brain seeks to combine related inputs from different senses (e.g., hearing and vision), via multisensory integration. Temporal information can indicate whether stimuli in different senses are related or not. A recent human fMRI study (Noesselt et al. [2007]: J Neurosci 27:11431-11441) used auditory and visual trains of beeps and flashes with erratic timing, manipulating whether auditory and visual trains were synchronous or unrelated in temporal pattern. A region of superior temporal sulcus (STS) showed higher BOLD signal for the synchronous condition. But this could not be related to performance, and it remained unclear if the erratic, unpredictable nature of the stimulus trains was important. Here we compared synchronous audiovisual trains to asynchronous trains, while using a behavioral task requiring detection of higher-intensity target events in either modality. We further varied whether the stimulus trains had predictable temporal pattern or not. Synchrony (versus lag) between auditory and visual trains enhanced behavioral sensitivity (d') to intensity targets in either modality, regardless of predictable versus unpredictable patterning. The analogous contrast in fMRI revealed BOLD increases in several brain areas, including the left STS region reported by Noesselt et al. [2007: J Neurosci 27:11431-11441]. The synchrony effect on BOLD here correlated with the subject-by-subject impact on performance. Predictability of temporal pattern did not affect target detection performance or STS activity, but did lead to an interaction with audiovisual synchrony for BOLD in inferior parietal cortex.

Human visual short-term memory precision can be varied at will when the number of retained items is low.

It has been debated whether human visual working memory is limited by the number of items or the precision with which they are represented. In the research reported here, we show that the precision of working memory can be flexibly and willfully controlled, but only if the number of retained items is low. Electroencephalographic recordings revealed that a neural marker for visual working memory (contralateral delay activity, or CDA) that is known to increase in amplitude with the number of retained items was also affected by the precision with which items were retained. However, willfully enhanced precision increased CDA amplitude only when the number of retained items was low. These results show that both the number and the (willfully controlled) precision of retained items constrain visual working memory: People can enhance the precision of their visual working memory, but only for a few items.

Influence of dopaminergically mediated reward on somatosensory decision-making.

UNLABELLED: Reward-related dopaminergic influences on learning and overt behaviour are well established, but any influence on sensory decision-making is largely unknown. We used functional magnetic resonance imaging (fMRI) while participants judged electric somatosensory stimuli on one hand or other, before being rewarded for correct performance at trial end via a visual signal, at one of four anticipated financial levels. Prior to the procedure, participants received either placebo (saline), a dopamine agonist (levodopa), or an antagonist (haloperidol). PRINCIPAL FINDINGS: higher anticipated reward improved tactile decisions. Visually signalled reward reactivated primary somatosensory cortex for the judged hand, more strongly for higher reward. After receiving a higher reward on one trial, somatosensory activations and decisions were enhanced on the next trial. These behavioural and neural effects were all enhanced by levodopa and attenuated by haloperidol, indicating dopaminergic dependency. Dopaminergic reward-related influences extend even to early somatosensory cortex and sensory decision-making.