Recalibration of path integration in hippocampal place cells.

Hippocampal place cells are spatially tuned neurons that serve as elements of a 'cognitive map' in the mammalian brain1. To detect the animal's location, place cells are thought to rely upon two interacting mechanisms: sensing the position of the animal relative to familiar landmarks2,3 and measuring the distance and direction that the animal has travelled from previously occupied locations4-7. The latter mechanism-known as path integration-requires a finely tuned gain factor that relates the animal's self-movement to the updating of position on the internal cognitive map, as well as external landmarks to correct the positional error that accumulates8,9. Models of hippocampal place cells and entorhinal grid cells based on path integration treat the path-integration gain as a constant9-14, but behavioural evidence in humans suggests that the gain is modifiable15. Here we show, using physiological evidence from rat hippocampal place cells, that the path-integration gain is a highly plastic variable that can be altered by persistent conflict between self-motion cues and feedback from external landmarks. In an augmented-reality system, visual landmarks were moved in proportion to the movement of a rat on a circular track, creating continuous conflict with path integration. Sustained exposure to this cue conflict resulted in predictable and prolonged recalibration of the path-integration gain, as estimated from the place cells after the landmarks were turned off. We propose that this rapid plasticity keeps the positional update in register with the movement of the rat in the external world over behavioural timescales. These results also demonstrate that visual landmarks not only provide a signal to correct cumulative error in the path-integration system4,8,16-19, but also rapidly fine-tune the integration computation itself.

Coherent encoding of subjective spatial position in visual cortex and hippocampus.

A major role of vision is to guide navigation, and navigation is strongly driven by vision1-4. Indeed, the brain's visual and navigational systems are known to interact5,6, and signals related to position in the environment have been suggested to appear as early as in the visual cortex6,7. Here, to establish the nature of these signals, we recorded in the primary visual cortex (V1) and hippocampal area CA1 while mice traversed a corridor in virtual reality. The corridor contained identical visual landmarks in two positions, so that a purely visual neuron would respond similarly at those positions. Most V1 neurons, however, responded solely or more strongly to the landmarks in one position rather than the other. This modulation of visual responses by spatial location was not explained by factors such as running speed. To assess whether the modulation is related to navigational signals and to the animal's subjective estimate of position, we trained the mice to lick for a water reward upon reaching a reward zone in the corridor. Neuronal populations in both CA1 and V1 encoded the animal's position along the corridor, and the errors in their representations were correlated. Moreover, both representations reflected the animal's subjective estimate of position, inferred from the animal's licks, better than its actual position. When animals licked in a given location-whether correctly or incorrectly-neural populations in both V1 and CA1 placed the animal in the reward zone. We conclude that visual responses in V1 are controlled by navigational signals, which are coherent with those encoded in hippocampus and reflect the animal's subjective position. The presence of such navigational signals as early as a primary sensory area suggests that they permeate sensory processing in the cortex.

AI, visual imagery, and a case study on the challenges posed by human intelligence tests.

Observations abound about the power of visual imagery in human intelligence, from how Nobel prize-winning physicists make their discoveries to how children understand bedtime stories. These observations raise an important question for cognitive science, which is, what are the computations taking place in someone's mind when they use visual imagery? Answering this question is not easy and will require much continued research across the multiple disciplines of cognitive science. Here, we focus on a related and more circumscribed question from the perspective of artificial intelligence (AI): If you have an intelligent agent that uses visual imagery-based knowledge representations and reasoning operations, then what kinds of problem solving might be possible, and how would such problem solving work? We highlight recent progress in AI toward answering these questions in the domain of visuospatial reasoning, looking at a case study of how imagery-based artificial agents can solve visuospatial intelligence tests. In particular, we first examine several variations of imagery-based knowledge representations and problem-solving strategies that are sufficient for solving problems from the Raven's Progressive Matrices intelligence test. We then look at how artificial agents, instead of being designed manually by AI researchers, might learn portions of their own knowledge and reasoning procedures from experience, including learning visuospatial domain knowledge, learning and generalizing problem-solving strategies, and learning the actual definition of the task in the first place.

Connectivity at the origins of domain specificity in the cortical face and place networks.

It is well established that the adult brain contains a mosaic of domain-specific networks. But how do these domain-specific networks develop? Here we tested the hypothesis that the brain comes prewired with connections that precede the development of domain-specific function. Using resting-state fMRI in the youngest sample of newborn humans tested to date, we indeed found that cortical networks that will later develop strong face selectivity (including the "proto" occipital face area and fusiform face area) and scene selectivity (including the "proto" parahippocampal place area and retrosplenial complex) by adulthood, already show domain-specific patterns of functional connectivity as early as 27 d of age (beginning as early as 6 d of age). Furthermore, we asked how these networks are functionally connected to early visual cortex and found that the proto face network shows biased functional connectivity with foveal V1, while the proto scene network shows biased functional connectivity with peripheral V1. Given that faces are almost always experienced at the fovea, while scenes always extend across the entire periphery, these differential inputs may serve to facilitate domain-specific processing in each network after that function develops, or even guide the development of domain-specific function in each network in the first place. Taken together, these findings reveal domain-specific and eccentricity-biased connectivity in the earliest days of life, placing new constraints on our understanding of the origins of domain-specific cortical networks.

Does the Size-Arrival Effect Occur With an Active Collision-Avoidance Task in an Immersive 3D Virtual Reality Environment?

OBJECTIVE: Determine whether the size-arrival effect (SAE) occurs with immersive, 3D visual experiences and active collision-avoidance responses. BACKGROUND: When a small near object and a large far object approach the observer at the same speeds, the large object appears to arrive before the small object, known as the size-arrival effect (SAE), which may contribute to crashes between motorcycles and cars. Prior studies of the SAE were limited because they used two dimensional displays and asked participants to make passive judgments. METHOD: Participants viewed approaching objects using a virtual reality (VR) headset. In an active task, participants ducked before the object hit them. In a passive prediction-motion (PM) judgment, the approaching object disappeared, and participants pressed a button when they thought the object would hit them. In a passive relative TTC judgment, participants reported which of two approaching objects would reach them first. RESULTS: The SAE occurred with the PM and relative TTC tasks but not with the ducking task. The SAE can occur in immersive 3D environments but is limited by the nature of the task and display. APPLICATION: Certain traffic situations may be more prone to the SAE and have higher risk for collisions. For example, in left-turn scenarios (e.g., see Levulis, 2018), drivers make passive judgments when oncoming vehicles are far and optical expansion is slow, and binocular disparity putatively is ineffective. Collision-avoidance warning systems may be needed more in such scenarios than when vehicles are near and drivers' judgments of TTC may be more accurate (DeLucia, 2008).

The Extent of Task Specificity for Visual and Tactile Sequences in the Auditory Cortex of the Deaf and Hard of Hearing.

It has been proposed that the auditory cortex in the deaf humans might undergo task-specific reorganization. However, evidence remains scarce as previous experiments used only two very specific tasks (temporal processing and face perception) in visual modality. Here, congenitally deaf/hard of hearing and hearing women and men were enrolled in an fMRI experiment as we sought to fill this evidence gap in two ways. First, we compared activation evoked by a temporal processing task performed in two different modalities, visual and tactile. Second, we contrasted this task with a perceptually similar task that focuses on the spatial dimension. Additional control conditions consisted of passive stimulus observation. In line with the task specificity hypothesis, the auditory cortex in the deaf was activated by temporal processing in both visual and tactile modalities. This effect was selective for temporal processing relative to spatial discrimination. However, spatial processing also led to significant auditory cortex recruitment which, unlike temporal processing, occurred even during passive stimulus observation. We conclude that auditory cortex recruitment in the deaf and hard of hearing might involve interplay between task-selective and pluripotential mechanisms of cross-modal reorganization. Our results open several avenues for the investigation of the full complexity of the cross-modal plasticity phenomenon.SIGNIFICANCE STATEMENT Previous studies suggested that the auditory cortex in the deaf may change input modality (sound to vision) while keeping its function (e.g., rhythm processing). We investigated this hypothesis by asking deaf or hard of hearing and hearing adults to discriminate between temporally and spatially complex sequences in visual and tactile modalities. The results show that such function-specific brain reorganization, as has previously been demonstrated in the visual modality, also occurs for tactile processing. On the other hand, they also show that for some stimuli (spatial) the auditory cortex activates automatically, which is suggestive of a take-over by a different kind of cognitive function. The observed differences in processing of sequences might thus result from an interplay of task-specific and pluripotent plasticity.

Rabbits use both spectral and temporal cues to discriminate the fundamental frequency of harmonic complexes with missing fundamentals.

The pitch of harmonic complex tones (HCTs) common in speech, music, and animal vocalizations plays a key role in the perceptual organization of sound. Unraveling the neural mechanisms of pitch perception requires animal models, but little is known about complex pitch perception by animals, and some species appear to use different pitch mechanisms than humans. Here, we tested rabbits' ability to discriminate the fundamental frequency (F0) of HCTs with missing fundamentals, using a behavioral paradigm inspired by foraging behavior in which rabbits learned to harness a spatial gradient in F0 to find the location of a virtual target within a room for a food reward. Rabbits were initially trained to discriminate HCTs with F0s in the range 400-800 Hz and with harmonics covering a wide frequency range (800-16,000 Hz) and then tested with stimuli differing in spectral composition to test the role of harmonic resolvability (experiment 1) or in F0 range (experiment 2) or in both F0 and spectral content (experiment 3). Together, these experiments show that rabbits can discriminate HCTs over a wide F0 range (200-1,600 Hz) encompassing the range of conspecific vocalizations and can use either the spectral pattern of harmonics resolved by the cochlea for higher F0s or temporal envelope cues resulting from interaction between unresolved harmonics for lower F0s. The qualitative similarity of these results to human performance supports the use of rabbits as an animal model for studies of pitch mechanisms, providing species differences in cochlear frequency selectivity and F0 range of vocalizations are taken into account.NEW & NOTEWORTHY Understanding the neural mechanisms of pitch perception requires experiments in animal models, but little is known about pitch perception by animals. Here we show that rabbits, a popular animal in auditory neuroscience, can discriminate complex sounds differing in pitch using either spectral cues or temporal cues. The results suggest that the role of spectral cues in pitch perception by animals may have been underestimated by predominantly testing low frequencies in the range of human voice.

Causal inference regulates audiovisual spatial recalibration via its influence on audiovisual perception.

To obtain a coherent perception of the world, our senses need to be in alignment. When we encounter misaligned cues from two sensory modalities, the brain must infer which cue is faulty and recalibrate the corresponding sense. We examined whether and how the brain uses cue reliability to identify the miscalibrated sense by measuring the audiovisual ventriloquism aftereffect for stimuli of varying visual reliability. To adjust for modality-specific biases, visual stimulus locations were chosen based on perceived alignment with auditory stimulus locations for each participant. During an audiovisual recalibration phase, participants were presented with bimodal stimuli with a fixed perceptual spatial discrepancy; they localized one modality, cued after stimulus presentation. Unimodal auditory and visual localization was measured before and after the audiovisual recalibration phase. We compared participants' behavior to the predictions of three models of recalibration: (a) Reliability-based: each modality is recalibrated based on its relative reliability-less reliable cues are recalibrated more; (b) Fixed-ratio: the degree of recalibration for each modality is fixed; (c) Causal-inference: recalibration is directly determined by the discrepancy between a cue and its estimate, which in turn depends on the reliability of both cues, and inference about how likely the two cues derive from a common source. Vision was hardly recalibrated by audition. Auditory recalibration by vision changed idiosyncratically as visual reliability decreased: the extent of auditory recalibration either decreased monotonically, peaked at medium visual reliability, or increased monotonically. The latter two patterns cannot be explained by either the reliability-based or fixed-ratio models. Only the causal-inference model of recalibration captures the idiosyncratic influences of cue reliability on recalibration. We conclude that cue reliability, causal inference, and modality-specific biases guide cross-modal recalibration indirectly by determining the perception of audiovisual stimuli.

Three-Year Reliability of MEG Visual and Somatosensory Responses.

A major goal of many translational neuroimaging studies is the identification of biomarkers of disease. However, a prerequisite for any such biomarker is robust reliability, which for magnetoencephalography (MEG) and many other imaging modalities has not been established. In this study, we examined the reliability of visual (Experiment 1) and somatosensory gating (Experiment 2) responses in 19 healthy adults who repeated these experiments for three visits spaced 18 months apart. Visual oscillatory and somatosensory oscillatory and evoked responses were imaged, and intraclass correlation coefficients (ICC) were computed to examine the long-term reliability of these responses. In Experiment 1, ICCs showed good reliability for visual theta and alpha responses in occipital cortices, but poor reliability for gamma responses. In Experiment 2, the time series of somatosensory gamma and evoked responses in the contralateral somatosensory cortex showed good reliability. Finally, analyses of spontaneous baseline activity indicated excellent reliability for occipital alpha, moderate reliability for occipital theta, and poor reliability for visual/somatosensory gamma activity. Overall, MEG responses to visual and somatosensory stimuli show a high degree of reliability across 3 years and therefore may be stable indicators of sensory processing long term and thereby of potential interest as biomarkers of disease.

Children with Cerebral Palsy Have Altered Occipital Cortical Oscillations during a Visuospatial Attention Task.

Dynamically allocating neural resources to salient features or objects within our visual space is fundamental to making rapid and accurate decisions. Impairments in such visuospatial abilities have been consistently documented in the clinical literature on individuals with cerebral palsy (CP), although the underlying neural mechanisms are poorly understood. In this study, we used magnetoencephalography (MEG) and oscillatory analysis methods to examine visuospatial processing in children with CP and demographically matched typically developing (TD) children. Our results indicated robust oscillations in the theta (4-8 Hz), alpha (8-14 Hz), and gamma (64-80 Hz) frequency bands in the occipital cortex of both groups during visuospatial processing. Importantly, the group with CP exhibited weaker cortical oscillations in the theta and gamma frequency bands, as well as slower response times and worse accuracy during task performance compared to the TD children. Furthermore, we found that weaker theta and gamma oscillations were related to greater visuospatial performance deficits across both groups. We propose that the weaker occipital oscillations seen in children with CP may reflect poor bottom-up processing of incoming visual information, which subsequently affects the higher-order visual computations essential for accurate visual perception and integration for decision-making.

Moving Toward versus Away from Another: How Body Motion Direction Changes the Representation of Bodies and Actions in the Visual Cortex.

Representing multiple agents and their mutual relations is a prerequisite to understand social events such as interactions. Using functional magnetic resonance imaging on human adults, we show that visual areas dedicated to body form and body motion perception contribute to processing social events, by holding the representation of multiple moving bodies and encoding the spatial relations between them. In particular, seeing animations of human bodies facing and moving toward (vs. away from) each other increased neural activity in the body-selective cortex [extrastriate body area (EBA)] and posterior superior temporal sulcus (pSTS) for biological motion perception. In those areas, representation of body postures and movements, as well as of the overall scene, was more accurate for facing body (vs. nonfacing body) stimuli. Effective connectivity analysis with dynamic causal modeling revealed increased coupling between EBA and pSTS during perception of facing body stimuli. The perceptual enhancement of multiple-body scenes featuring cues of interaction (i.e., face-to-face positioning, spatial proximity, and approaching signals) was supported by the participants' better performance in a recognition task with facing body versus nonfacing body stimuli. Thus, visuospatial cues of interaction in multiple-person scenarios affect the perceptual representation of body and body motion and, by promoting functional integration, streamline the process from body perception to action representation.

Multiple interactive memory representations underlie the induction of false memory.

Theoretical and computational models such as transfer-appropriate processing (TAP) and global matching models have emphasized the encoding-retrieval interaction of memory representations in generating false memories, but relevant neural mechanisms are still poorly understood. By manipulating the sensory modalities (visual and auditory) at different processing stages (learning and test) in the Deese-Roediger-McDermott task, we found that the auditory-learning visual-test (AV) group produced more false memories (59%) than the other three groups (42∼44%) [i.e., visual learning visual test (VV), auditory learning auditory test (AA), and visual learning auditory test (VA)]. Functional imaging results showed that the AV group's proneness to false memories was associated with (i) reduced representational match between the tested item and all studied items in the visual cortex, (ii) weakened prefrontal monitoring process due to the reliance on frontal memory signal for both targets and lures, and (iii) enhanced neural similarity for semantically related words in the temporal pole as a result of auditory learning. These results are consistent with the predictions based on the TAP and global matching models and highlight the complex interactions of representations during encoding and retrieval in distributed brain regions that contribute to false memories.

Discrete Patterns of Cross-Hemispheric Functional Connectivity Underlie Impairments of Spatial Cognition after Stroke.

Despite intense research, the neural correlates of stroke-induced deficits of spatial cognition remain controversial. For example, several cortical regions and white-matter tracts have been designated as possible anatomic predictors of spatial neglect. However, many studies focused on local anatomy, an approach that does not harmonize with the notion that brain-behavior relationships are flexible and may involve interactions among distant regions. We studied in humans of either sex resting-state fMRI connectivity associated with performance in line bisection, reading and visual search, tasks commonly used for he clinical diagnosis of neglect. We defined left and right frontal, parietal, and temporal areas as seeds (or regions of interest, ROIs), and measured whole-brain seed-based functional connectivity (FC) and ROI-to-ROI connectivity in subacute right-hemisphere stroke patients. Performance on the line bisection task was associated with decreased FC between the right fusiform gyrus and left superior occipital cortex. Complementary increases and decreases of connectivity between both temporal and occipital lobes predicted reading errors. In addition, visual search deficits were associated with modifications of FC between left and right inferior parietal lobes and right insular cortex. These distinct connectivity patterns were substantiated by analyses of FC between left- and right-hemispheric ROIs, which revealed that decreased interhemispheric and right intrahemispheric FC was associated with higher levels of impairment. Together, these findings indicate that intrahemispheric and interhemispheric cooperation between brain regions lying outside the damaged area contributes to spatial deficits in a way that depends on the different cognitive components recruited during reading, spatial judgments, and visual exploration.SIGNIFICANCE STATEMENT Focal damage to the right cerebral hemisphere may result in a variety of deficits, often affecting the domain of spatial cognition. The neural correlates of these disorders have traditionally been studied with lesion-symptom mapping, but this method fails to capture the network dynamics that underlie cognitive performance. We studied functional connectivity in patients with right-hemisphere stroke and found a pattern of correlations between the left and right temporo-occipital, inferior parietal, and right insular cortex that were distinctively predictive of deficits in reading, spatial judgment, and visual exploration. This finding reveals the importance of interhemispheric interactions and network adaptations for the manifestation of spatial deficits after damage to the right hemisphere.

From ATOM to GradiATOM: Cortical gradients support time and space processing as revealed by a meta-analysis of neuroimaging studies.

According to the ATOM (A Theory Of Magnitude), formulated by Walsh more than fifteen years ago, there is a general system of magnitude in the brain that comprises regions, such as the parietal cortex, shared by space, time and other magnitudes. The present meta-analysis of neuroimaging studies used the Activation Likelihood Estimation (ALE) method in order to determine the set of regions commonly activated in space and time processing and to establish the neural activations specific to each magnitude domain. Following PRISMA guidelines, we included in the analysis a total of 112 and 114 experiments, exploring space and time processing, respectively. We clearly identified the presence of a system of brain regions commonly recruited in both space and time that includes: bilateral insula, the pre-supplementary motor area (pre-SMA), the right frontal operculum and the intraparietal sulci. These regions might be the best candidates to form the core magnitude neural system. Surprisingly, along each of these regions but the insula, ALE values progressed in a cortical gradient from time to space. The SMA exhibited an anterior-posterior gradient, with space activating more-anterior regions (i.e., pre-SMA) and time activating more-posterior regions (i.e., SMA-proper). Frontal and parietal regions showed a dorsal-ventral gradient: space is mediated by dorsal frontal and parietal regions, and time recruits ventral frontal and parietal regions. Our study supports but also expands the ATOM theory. Therefore, we here re-named it the 'GradiATOM' theory (Gradient Theory of Magnitude), proposing that gradient organization can facilitate the transformations and integrations of magnitude representations by allowing space- and time-related neural populations to interact with each other over minimal distances.

Causal role of frontal-midline theta in cognitive effort: a pilot study.

Frontal-midline theta (FMT) oscillations are increased in amplitude during cognitive control tasks. Since these tasks often conflate cognitive control and cognitive effort, it remains unknown if FMT amplitude maps onto cognitive control or effort. To address this gap, we utilized the glucose facilitation effect to manipulate cognitive effort without changing cognitive control demands. We performed a single-blind, crossover human study in which we provided participants with a glucose drink (control session: volume-matched water) to reduce cognitive effort and improve performance on a visuospatial working memory task. Following glucose consumption, participants performed the working memory task at multiple time points of a 3-h window to sample across the rise and fall of blood glucose. Using high-density electroencephalography (EEG), we calculated FMT amplitude during the delay period of the working memory task. Source localization analysis revealed that FMT oscillations originated from bilateral prefrontal cortex. We found that glucose increased working memory accuracy during the high working memory load condition but decreased FMT amplitude. The decrease in FMT amplitude coincided with both peak blood glucose elevation and peak performance enhancement for glucose relative to water. Therefore, the positive association between glucose consumption and task performance provided causal evidence that the amplitude of FMT oscillations may correspond to cognitive effort, rather than cognitive control. Due to the COVID-19 pandemic, data collection was terminated prematurely; the preliminary nature of these findings due to small sample size should be contextualized by rigorous experimental design and use of a novel causal perturbation to dissociate cognitive effort and cognitive control.NEW & NOTEWORTHY We investigated whether frontal-midline theta (FMT) oscillations tracked with cognitive control or cognitive effort by simultaneous manipulation of cognitive control demands in a working memory task and causal perturbation of cognitive effort using glucose consumption. Facilitation of performance from glucose consumption corresponded with decreased FMT amplitude, which provided preliminary causal evidence for a relationship between FMT amplitude with cognitive effort.

The separate and combined properties of the granular (area 29) and dysgranular (area 30) retrosplenial cortex.

Retrosplenial cortex contains two principal subdivisions, area 29 (granular) and area 30 (dysgranular). Their respective anatomical connections in the rat brain reveal that area 29 is the primary recipient of hippocampal and parahippocampal spatial and contextual information while area 30 is the primary interactor with current visual information. Lesion studies and measures of neuronal activity in rodents indicate that retrosplenial cortex helps to integrate space from different perspectives, e.g., egocentric and allocentric, providing landmark and heading cues for navigation and spatial learning. It provides a repository of scene information that, over time, becomes increasingly independent of the hippocampus. These processes, reflect the interactive actions between areas 29 and 30, along with their convergent influences on cortical and thalamic targets. Consequently, despite their differences, both areas 29 and 30 are necessary for an array of spatial and learning problems.

Roles of the ventral hippocampus and medial prefrontal cortex in spatial reversal learning and attentional set-shifting.

Neural components enabling flexible cognition and behavior are well-established, and depend mostly on proper intercommunication within the prefrontal cortex (PFC) and striatum. However, dense projections from the ventral hippocampus (vHPC) alter the functioning of the medial PFC (mPFC). Dysfunctional hippocampo-prefrontal connectivity negatively affects the integrity of flexible cognition, especially in patients with schizophrenia. In this study, we aimed to test the role of the vHPC and mPFC in a place avoidance task on a rotating arena using two spatial flexibility task variants - reversal learning and set-shifting. To achieve this, we inactivated each of these structures in adult male Long-Evans rats by performing bilateral local muscimol (a GABAA receptor agonist) injections. A significantly disrupted performance was observed in reversal learning in the vHPC-inactivated, but not in the mPFC-inactivated rats. These results confirm the notion that the vHPC participates in some forms of behavioral flexibility, especially when spatial cues are needed. It seems, rather unexpectedly, that the mPFC is not taxed in these flexibility tasks on a rotating arena.

The memory for time and space differentially engages the proximal and distal parts of the hippocampal subfields CA1 and CA3.

A well-accepted model of episodic memory involves the processing of spatial and non-spatial information by segregated pathways and their association within the hippocampus. However, these pathways project to distinct proximodistal levels of the hippocampus. Moreover, spatial and non-spatial subnetworks segregated along this axis have been recently described using memory tasks with either a spatial or a non-spatial salient dimension. Here, we tested whether the concept of segregated subnetworks and the traditional model are reconcilable by studying whether activity within CA1 and CA3 remains segregated when both dimensions are salient, as is the case for episodes. Simultaneously, we investigated whether temporal or spatial information bound to objects recruits similar subnetworks as items or locations per se, respectively. To do so, we studied the correlations between brain activity and spatial and/or temporal discrimination ratios in proximal and distal CA1 and CA3 by detecting Arc RNA in mice. We report a robust proximodistal segregation in CA1 for temporal information processing and in both CA1 and CA3 for spatial information processing. Our results suggest that the traditional model of episodic memory and the concept of segregated networks are reconcilable, to a large extent and put forward distal CA1 as a possible "home" location for time cells.

Contextual and Spatial Associations Between Objects Interactively Modulate Visual Processing.

Much of what we know about object recognition arises from the study of isolated objects. In the real world, however, we commonly encounter groups of contextually associated objects (e.g., teacup and saucer), often in stereotypical spatial configurations (e.g., teacup above saucer). Here we used electroencephalography to test whether identity-based associations between objects (e.g., teacup-saucer vs. teacup-stapler) are encoded jointly with their typical relative positioning (e.g., teacup above saucer vs. below saucer). Observers viewed a 2.5-Hz image stream of contextually associated object pairs intermixed with nonassociated pairs as every fourth image. The differential response to nonassociated pairs (measurable at 0.625 Hz in 28/37 participants) served as an index of contextual integration, reflecting the association of object identities in each pair. Over right occipitotemporal sites, this signal was larger for typically positioned object streams, indicating that spatial configuration facilitated the extraction of the objects' contextual association. This high-level influence of spatial configuration on object identity integration arose ~ 320 ms post-stimulus onset, with lower-level perceptual grouping (shared with inverted displays) present at ~ 130 ms. These results demonstrate that contextual and spatial associations between objects interactively influence object processing. We interpret these findings as reflecting the high-level perceptual grouping of objects that frequently co-occur in highly stereotyped relative positions.

Shifts of Spatial Attention in Visual and Tactile Working Memory are Controlled by Independent Modality-Specific Mechanisms.

The question whether the attentional control of working memory (WM) is shared across sensory modalities remains controversial. Here, we investigated whether attention shifts in visual and tactile WM are regulated independently. Participants memorized visual and tactile targets in a first memory sample set (S1) before encoding targets in a second sample set (S2). Importantly, visual or tactile S2 targets could appear on the same side as the corresponding S1 targets, or on opposite sides, thus, requiring shifts of spatial attention in visual or tactile WM. The activation of WM representations in modality-specific visual and somatosensory areas was tracked by recording visual and tactile contralateral delay activity (CDA/tCDA). CDA/tCDA components emerged contralateral to the side of visual or tactile S1 targets, and reversed polarity when S2 targets in the same modality appeared on the opposite side. Critically, the visual CDA was unaffected by the presence versus absence of concurrent attention shifts in tactile WM, and the tactile CDA remained insensitive to visual attention shifts. Visual and tactile WM performance was also not modulated by attention shifts in the other modality. These results show that the dynamic control of visual and tactile WM activation processes operates in an independent modality-specific fashion.