Active search signatures in a free-viewing task exploiting concurrent EEG and eye movements recordings.

Tasks we often perform in our everyday lives, such as reading or looking for a friend in the crowd, are seemingly straightforward but they actually require the orchestrated activity of several cognitive processes. Free-viewing visual search requires a plan to move our gaze on the different items, identifying them, and deciding on whether to continue with the search. Little is known about the electrophysiological signatures of these processes in free-viewing because there are technical challenges associated with eye movement artefacts. Here, we aimed to study how category information, as well as ecologically relevant variables such as the task performed, influence brain activity in a free-viewing paradigm. Participants were asked to observe/search from an array of faces and objects embedded in random noise. We concurrently recorded electroencephalogram and eye movements and applied a deconvolution analysis approach to estimate the contribution of the different elements embedded in the task. Consistent with classical fixed-gaze experiments and a handful of free-viewing studies, we found a robust categorical effect around 150 ms in occipital and occipitotemporal electrodes. We also report a task effect, more negative in posterior central electrodes in visual search compared with exploration, starting at around 80 ms. We also found significant effects of trial progression and an interaction with the task effect. Overall, these results generalise the characterisation of early visual face processing to a wider range of experiments and show how a suitable analysis approach allows to discern among multiple neural contributions to the signal, preserving key attributes of real-world tasks.

STDP Forms Associations between Memory Traces in Networks of Spiking Neurons.

Memory traces and associations between them are fundamental for cognitive brain function. Neuron recordings suggest that distributed assemblies of neurons in the brain serve as memory traces for spatial information, real-world items, and concepts. However, there is conflicting evidence regarding neural codes for associated memory traces. Some studies suggest the emergence of overlaps between assemblies during an association, while others suggest that the assemblies themselves remain largely unchanged and new assemblies emerge as neural codes for associated memory items. Here we study the emergence of neural codes for associated memory items in a generic computational model of recurrent networks of spiking neurons with a data-constrained rule for spike-timing-dependent plasticity. The model depends critically on 2 parameters, which control the excitability of neurons and the scale of initial synaptic weights. By modifying these 2 parameters, the model can reproduce both experimental data from the human brain on the fast formation of associations through emergent overlaps between assemblies, and rodent data where new neurons are recruited to encode the associated memories. Hence, our findings suggest that the brain can use both of these 2 neural codes for associations, and dynamically switch between them during consolidation.

Scene-selective coding by single neurons in the human parahippocampal cortex.

Imaging, electrophysiological, and lesion studies have shown a relationship between the parahippocampal cortex (PHC) and the processing of spatial scenes. Our present knowledge of PHC, however, is restricted to the macroscopic properties and dynamics of bulk tissue; the behavior and selectivity of single parahippocampal neurons remains largely unknown. In this study, we analyzed responses from 630 parahippocampal neurons in 24 neurosurgical patients during visual stimulus presentation. We found a spatially clustered subpopulation of scene-selective units with an associated event-related field potential. These units form a population code that is more distributed for scenes than for other stimulus categories, and less sparse than elsewhere in the medial temporal lobe. Our electrophysiological findings provide insight into how individual units give rise to the population response observed with functional imaging in the parahippocampal place area.

Parsing a mental program: Fixation-related brain signatures of unitary operations and routines in natural visual search.

Visual search involves a sequence or routine of unitary operations (i.e. fixations) embedded in a larger mental global program. The process can indeed be seen as a program based on a while loop (while the target is not found), a conditional construct (whether the target is matched or not based on specific recognition algorithms) and a decision making step to determine the position of the next searched location based on existent evidence. Recent developments in our ability to co-register brain scalp potentials (EEG) during free eye movements has allowed investigating brain responses related to fixations (fixation-Related Potentials; fERPs), including the identification of sensory and cognitive local EEG components linked to individual fixations. However, the way in which the mental program guiding the search unfolds has not yet been investigated. We performed an EEG and eye tracking co-registration experiment in which participants searched for a target face in natural images of crowds. Here we show how unitary steps of the program are encoded by specific local target detection signatures and how the positioning of each unitary operation within the global search program can be pinpointed by changes in the EEG signal amplitude as well as the signal power in different frequency bands. By simultaneously studying brain signatures of unitary operations and those occurring during the sequence of fixations, our study sheds light into how local and global properties are combined in implementing visual routines in natural tasks.

Specific responses of human hippocampal neurons are associated with better memory.

A population of human hippocampal neurons has shown responses to individual concepts (e.g., Jennifer Aniston) that generalize to different instances of the concept. However, recordings from the rodent hippocampus suggest an important function of these neurons is their ability to discriminate overlapping representations, or pattern separate, a process that may facilitate discrimination of similar events for successful memory. In the current study, we explored whether human hippocampal neurons can also demonstrate the ability to discriminate between overlapping representations and whether this selectivity could be directly related to memory performance. We show that among medial temporal lobe (MTL) neurons, certain populations of neurons are selective for a previously studied (target) image in that they show a significant decrease in firing rate to very similar (lure) images. We found that a greater proportion of these neurons can be found in the hippocampus compared with other MTL regions, and that memory for individual items is correlated to the degree of selectivity of hippocampal neurons responsive to those items. Moreover, a greater proportion of hippocampal neurons showed selective firing for target images in good compared with poor performers, with overall memory performance correlated with hippocampal selectivity. In contrast, selectivity in other MTL regions was not associated with memory performance. These findings show that a substantial proportion of human hippocampal neurons encode specific memories that support the discrimination of overlapping representations. These results also provide previously unidentified evidence consistent with a unique role of the human hippocampus in orthogonalization of representations in declarative memory.

Single-cell recordings in the human medial temporal lobe.

Recordings from individual neurons in patients who are implanted with depth electrodes for clinical reasons have opened the possibility to narrow down the gap between neurophysiological studies in animals and non-invasive (e.g. functional magnetic resonance imaging, electroencephalogram, magnetoencephalography) investigations in humans. Here we provide a description of the main procedures for electrode implantation and recordings, the experimental paradigms used and the main steps for processing the data. We also present key characteristics of the so-called 'concept cells', neurons in the human medial temporal lobe with selective and invariant responses that represent the meaning of the stimulus, and discuss their proposed role in declarative memory. Finally, we present novel results dealing with the stability of the representation given by these neurons, by studying the effect of stimulus repetition in the strength of the responses. In particular, we show that, after an initial decay, the response strength reaches an asymptotic value after approximately 15 presentations that remains above baseline for the whole duration of the experiment.

Mechanisms contributing to central excitability changes during hearing loss.

Exposure to loud sound causes cochlear damage resulting in hearing loss and tinnitus. Tinnitus has been related to hyperactivity in the central auditory pathway occurring weeks after loud sound exposure. However, central excitability changes concomitant to hearing loss and preceding those periods of hyperactivity, remain poorly explored. Here we investigate mechanisms contributing to excitability changes in the dorsal cochlear nucleus (DCN) shortly after exposure to loud sound that produces hearing loss. We show that acoustic overexposure alters synaptic transmission originating from the auditory and the multisensory pathway within the DCN in different ways. A reduction in the number of myelinated auditory nerve fibers leads to a reduced maximal firing rate of DCN principal cells, which cannot be restored by increasing auditory nerve fiber recruitment. In contrast, a decreased membrane resistance of DCN granule cells (multisensory inputs) leads to a reduced maximal firing rate of DCN principal cells that is overcome when additional multisensory fibers are recruited. Furthermore, gain modulation by inhibitory synaptic transmission is disabled in both auditory and multisensory pathways. These cellular mechanisms that contribute to decreased cellular excitability in the central auditory pathway are likely to represent early neurobiological markers of hearing loss and may suggest interventions to delay or stop the development of hyperactivity that has been associated with tinnitus.

Looking for a face in the crowd: fixation-related potentials in an eye-movement visual search task.

Despite the compelling contribution of the study of event related potentials (ERPs) and eye movements to cognitive neuroscience, these two approaches have largely evolved independently. We designed an eye-movement visual search paradigm that allowed us to concurrently record EEG and eye movements while subjects were asked to find a hidden target face in a crowded scene with distractor faces. Fixation event-related potentials (fERPs) to target and distractor stimuli showed the emergence of robust sensory components associated with the perception of stimuli and cognitive components associated with the detection of target faces. We compared those components with the ones obtained in a control task at fixation: qualitative similarities as well as differences in terms of scalp topography and latency emerged between the two. By using single trial analyses, fixations to target and distractors could be decoded from the EEG signals above chance level in 11 out of 12 subjects. Our results show that EEG signatures related to cognitive behavior develop across spatially unconstrained exploration of natural scenes and provide a first step towards understanding the mechanisms of target detection during natural search.

Fixation-related potentials in visual search: a combined EEG and eye tracking study.

We report a study of concurrent eye movements and electroencephalographic (EEG) recordings while subjects freely explored a search array looking for hidden targets. We describe a sequence of fixation-event related potentials (fERPs) that unfolds during ∼ 400 ms following each fixation. This sequence highly resembles the event-related responses in a replay experiment, in which subjects kept fixation while a sequence of images occurred around the fovea simulating the spatial and temporal patterns during the free viewing experiment. Similar responses were also observed in a second control experiment where the appearance of stimuli was controlled by the experimenters and presented at the center of the screen. We also observed a relatively early component (∼150 ms) that distinguished between targets and distractors only in the freeviewing condition. We present a novel approach to match the critical properties of two conditions (targets/distractors), which can be readily adapted to other paradigms to investigate EEG components during free eye-movements.

Selectivity of pyramidal cells and interneurons in the human medial temporal lobe.

Neurons in the medial temporal lobe (MTL) respond selectively to pictures of specific individuals, objects, and places. However, the underlying mechanisms leading to such degree of stimulus selectivity are largely unknown. A necessary step to move forward in this direction involves the identification and characterization of the different neuron types present in MTL circuitry. We show that putative principal cells recorded in vivo from the human MTL are more selective than putative interneurons. Furthermore, we report that putative hippocampal pyramidal cells exhibit the highest degree of selectivity within the MTL, reflecting the hierarchical processing of visual information. We interpret these differences in selectivity as a plausible mechanism for generating sparse responses.

Selectivity and invariance for visual object perception.

The sight of an object triggers a complex set of processes in the brain. Although it is already well established that object perception is performed by a hierarchical network, the so-called ventral visual pathway, we are only starting to understand how neurons along this pathway encode visual information at each processing stage. In this review, we discuss basic principles of neural coding for object perception and describe evidence showing that it mainly relies on two principles: selectivity and invariance.

Encoding of long-term associations through neural unitization in the human medial temporal lobe.

Besides decades of research showing the role of the medial temporal lobe (MTL) in memory and the encoding of associations, the neural substrates underlying these functions remain unknown. We identified single neurons in the human MTL that responded to multiple and, in most cases, associated stimuli. We observed that most of these neurons exhibit no differences in their spike and local field potential (LFP) activity associated with the individual response-eliciting stimuli. In addition, LFP responses in the theta band preceded single neuron responses by ~70 ms, with the single trial phase providing fine tuning of the spike response onset. We postulate that the finding of similar neuronal responses to associated items provides a simple and flexible way of encoding memories in the human MTL, increasing the effective capacity for memory storage and successful retrieval.

Long-term coding of personal and universal associations underlying the memory web in the human brain.

Neurons in the medial temporal lobe (MTL), a critical area for declarative memory, have been shown to change their tuning in associative learning tasks. Yet, it is unclear how durable these neuronal representations are and if they outlast the execution of the task. To address this issue, we studied the responses of MTL neurons in neurosurgical patients to known concepts (people and places). Using association scores provided by the patients and a web-based metric, here we show that whenever MTL neurons respond to more than one concept, these concepts are typically related. Furthermore, the degree of association between concepts could be successfully predicted based on the neurons' response patterns. These results provide evidence for a long-term involvement of MTL neurons in the representation of durable associations, a hallmark of human declarative memory.

Predicting episodic memory formation for movie events.

Episodic memories are long lasting and full of detail, yet imperfect and malleable. We quantitatively evaluated recollection of short audiovisual segments from movies as a proxy to real-life memory formation in 161 subjects at 15 minutes up to a year after encoding. Memories were reproducible within and across individuals, showed the typical decay with time elapsed between encoding and testing, were fallible yet accurate, and were insensitive to low-level stimulus manipulations but sensitive to high-level stimulus properties. Remarkably, memorability was also high for single movie frames, even one year post-encoding. To evaluate what determines the efficacy of long-term memory formation, we developed an extensive set of content annotations that included actions, emotional valence, visual cues and auditory cues. These annotations enabled us to document the content properties that showed a stronger correlation with recognition memory and to build a machine-learning computational model that accounted for episodic memory formation in single events for group averages and individual subjects with an accuracy of up to 80%. These results provide initial steps towards the development of a quantitative computational theory capable of explaining the subjective filtering steps that lead to how humans learn and consolidate memories.

Rapid Encoding of New Memories by Individual Neurons in the Human Brain.

The creation of memories about real-life episodes requires rapid neuronal changes that may appear after a single occurrence of an event. How is such demand met by neurons in the medial temporal lobe (MTL), which plays a fundamental role in episodic memory formation? We recorded the activity of MTL neurons in neurosurgical patients while they learned new associations. Pairs of unrelated pictures, one of a person and another of a place, were used to construct a meaningful association modeling the episodic memory of meeting a person in a particular place. We found that a large proportion of responsive MTL neurons expanded their selectivity to encode these specific associations within a few trials: cells initially responsive to one picture started firing to the associated one but not to others. Our results provide a plausible neural substrate for the inception of associations, which are crucial for the formation of episodic memories.

How many neurons can we see with current spike sorting algorithms?

Recent studies highlighted the disagreement between the typical number of neurons observed with extracellular recordings and the ones to be expected based on anatomical and physiological considerations. This disagreement has been mainly attributed to the presence of sparsely firing neurons. However, it is also possible that this is due to limitations of the spike sorting algorithms used to process the data. To address this issue, we used realistic simulations of extracellular recordings and found a relatively poor spike sorting performance for simulations containing a large number of neurons. In fact, the number of correctly identified neurons for single-channel recordings showed an asymptotic behavior saturating at about 8-10 units, when up to 20 units were present in the data. This performance was significantly poorer for neurons with low firing rates, as these units were twice more likely to be missed than the ones with high firing rates in simulations containing many neurons. These results uncover one of the main reasons for the relatively low number of neurons found in extracellular recording and also stress the importance of further developments of spike sorting algorithms.

Realistic simulation of extracellular recordings.

In this paper we present an efficient method to generate realistic simulations of extracellular recordings. The method uses a hybrid and computationally simple approach, where the features of the background noise arise naturally from its biophysical process of generation. The generated data resemble the characteristics of real recordings, as quantified by the amplitude and frequency distributions. Moreover, we reproduce real features that are specially challenging for the analysis of extracellular data, such as the presence of sparse firing neurons and multi-unit activity. We compare our simulations with real recordings from the human medial temporal lobe and exemplify their use for testing spike detection and sorting algorithms. These results show that this technique provides an optimal scenario for generating realistic simulations of extracellular recordings.