The neural representation of an auditory spatial cue in the primate cortex.

Humans make use of small differences in the timing of sounds at the two ears-interaural time differences (ITDs)-to locate their sources. Despite extensive investigation, however, the neural representation of ITDs in the human brain is contentious, particularly the range of ITDs explicitly represented by dedicated neural detectors. Here, using magneto- and electro-encephalography (MEG and EEG), we demonstrate evidence of a sparse neural representation of ITDs in the human cortex. The magnitude of cortical activity to sounds presented via insert earphones oscillated as a function of increasing ITD-within and beyond auditory cortical regions-and listeners rated the perceptual quality of these sounds according to the same oscillating pattern. This pattern was accurately described by a population of model neurons with preferred ITDs constrained to the narrow, sound-frequency-dependent range evident in other mammalian species. When scaled for head size, the distribution of ITD detectors in the human cortex is remarkably like that recorded in vivo from the cortex of rhesus monkeys, another large primate that uses ITDs for source localization. The data solve a long-standing issue concerning the neural representation of ITDs in humans and suggest a representation that scales for head size and sound frequency in an optimal manner.

Signal switching may enhance processing power of the brain.

Our ability to perceive multiple objects is mysterious. Sensory neurons are broadly tuned, producing potential overlap in the populations of neurons activated by each object in a scene. This overlap raises questions about how distinct information is retained about each item. We present a novel signal switching theory of neural representation, which posits that neural signals may interleave representations of individual items across time. Evidence for this theory comes from new statistical tools that overcome the limitations inherent to standard time-and-trial-pooled assessments of neural signals. Our theory has implications for diverse domains of neuroscience, including attention, figure binding/scene segregation, oscillations, and divisive normalization. The general concept of switching between functions could also lend explanatory power to theories of grounded cognition.

Multiple objects evoke fluctuating responses in several regions of the visual pathway.

How neural representations preserve information about multiple stimuli is mysterious. Because tuning of individual neurons is coarse (e.g., visual receptive field diameters can exceed perceptual resolution), the populations of neurons potentially responsive to each individual stimulus can overlap, raising the question of how information about each item might be segregated and preserved in the population. We recently reported evidence for a potential solution to this problem: when two stimuli were present, some neurons in the macaque visual cortical areas V1 and V4 exhibited fluctuating firing patterns, as if they responded to only one individual stimulus at a time (Jun et al., 2022). However, whether such an information encoding strategy is ubiquitous in the visual pathway and thus could constitute a general phenomenon remains unknown. Here, we provide new evidence that such fluctuating activity is also evoked by multiple stimuli in visual areas responsible for processing visual motion (middle temporal visual area, MT), and faces (middle fundus and anterolateral face patches in inferotemporal cortex - areas MF and AL), thus extending the scope of circumstances in which fluctuating activity is observed. Furthermore, consistent with our previous results in the early visual area V1, MT exhibits fluctuations between the representations of two stimuli when these form distinguishable objects but not when they fuse into one perceived object, suggesting that fluctuating activity patterns may underlie visual object formation. Taken together, these findings point toward an updated model of how the brain preserves sensory information about multiple stimuli for subsequent processing and behavioral action.

Neural Fluctuation Contrast as a Code for Complex Sounds: The Role and Control of Peripheral Nonlinearities.

The nonlinearities of the inner ear are often considered to be obstacles that the central nervous system has to overcome to decode neural responses to sounds. This review describes how peripheral nonlinearities, such as saturation of the inner-hair-cell response and of the IHC-auditory-nerve synapse, are instead beneficial to the neural encoding of complex sounds such as speech. These nonlinearities set up contrast in the depth of neural-fluctuations in auditory-nerve responses along the tonotopic axis, referred to here as neural fluctuation contrast (NFC). Physiological support for the NFC coding hypothesis is reviewed, and predictions of several psychophysical phenomena, including masked detection and speech intelligibility, are presented. Lastly, a framework based on the NFC code for understanding how the medial olivocochlear (MOC) efferent system contributes to the coding of complex sounds is presented. By modulating cochlear gain control in response to both sound energy and fluctuations in neural responses, the MOC system is hypothesized to function not as a simple feedback gain-control device, but rather as a mechanism for enhancing NFC along the tonotopic axis, enabling robust encoding of complex sounds across a wide range of sound levels and in the presence of background noise. Effects of sensorineural hearing loss on the NFC code and on the MOC feedback system are presented and discussed.

Optimal decoding of neural dynamics occurs at mesoscale spatial and temporal resolutions.

Introduction: Understanding the neural code has been one of the central aims of neuroscience research for decades. Spikes are commonly referred to as the units of information transfer, but multi-unit activity (MUA) recordings are routinely analyzed in aggregate forms such as binned spike counts, peri-stimulus time histograms, firing rates, or population codes. Various forms of averaging also occur in the brain, from the spatial averaging of spikes within dendritic trees to their temporal averaging through synaptic dynamics. However, how these forms of averaging are related to each other or to the spatial and temporal units of information representation within the neural code has remained poorly understood. Materials and methods: In this work we developed NeuroPixelHD, a symbolic hyperdimensional model of MUA, and used it to decode the spatial location and identity of static images shown to n = 9 mice in the Allen Institute Visual Coding-NeuroPixels dataset from large-scale MUA recordings. We parametrically varied the spatial and temporal resolutions of the MUA data provided to the model, and compared its resulting decoding accuracy. Results: For almost all subjects, we found 125ms temporal resolution to maximize decoding accuracy for both the spatial location of Gabor patches (81 classes for patches presented over a 9×9 grid) as well as the identity of natural images (118 classes corresponding to 118 images) across the whole brain. This optimal temporal resolution nevertheless varied greatly between different regions, followed a sensory-associate hierarchy, and was significantly modulated by the central frequency of theta-band oscillations across different regions. Spatially, the optimal resolution was at either of two mesoscale levels for almost all mice: the area level, where the spiking activity of all neurons within each brain area are combined, and the population level, where neuronal spikes within each area are combined across fast spiking (putatively inhibitory) and regular spiking (putatively excitatory) neurons, respectively. We also observed an expected interplay between optimal spatial and temporal resolutions, whereby increasing the amount of averaging across one dimension (space or time) decreases the amount of averaging that is optimal across the other dimension, and vice versa. Discussion: Our findings corroborate existing empirical practices of spatiotemporal binning and averaging in MUA data analysis, and provide a rigorous computational framework for optimizing the level of such aggregations. Our findings can also synthesize these empirical practices with existing knowledge of the various sources of biological averaging in the brain into a new theory of neural information processing in which the unit of information varies dynamically based on neuronal signal and noise correlations across space and time.

Absence of paresthesia during high-rate spinal cord stimulation reveals importance of synchrony for sensations evoked by electrical stimulation.

Electrically activating mechanoreceptive afferents inhibits pain. However, paresthesia evoked by spinal cord stimulation (SCS) at 40-60 Hz becomes uncomfortable at high pulse amplitudes, limiting SCS "dosage." Kilohertz-frequency SCS produces analgesia without paresthesia and is thought, therefore, not to activate afferent axons. We show that paresthesia is absent not because axons do not spike but because they spike asynchronously. In a pain patient, selectively increasing SCS frequency abolished paresthesia and epidurally recorded evoked compound action potentials (ECAPs). Dependence of ECAP amplitude on SCS frequency was reproduced in pigs, rats, and computer simulations and is explained by overdrive desynchronization: spikes desychronize when axons are stimulated faster than their refractory period. Unlike synchronous spikes, asynchronous spikes fail to produce paresthesia because their transmission to somatosensory cortex is blocked by feedforward inhibition. Our results demonstrate how stimulation frequency impacts synchrony based on axon properties and how synchrony impacts sensation based on circuit properties.

A view-based decision mechanism for rewards in the primate amygdala.

Primates make decisions visually by shifting their view from one object to the next, comparing values between objects, and choosing the best reward, even before acting. Here, we show that when monkeys make value-guided choices, amygdala neurons encode their decisions in an abstract, purely internal representation defined by the monkey's current view but not by specific object or reward properties. Across amygdala subdivisions, recorded activity patterns evolved gradually from an object-specific value code to a transient, object-independent code in which currently viewed and last-viewed objects competed to reflect the emerging view-based choice. Using neural-network modeling, we identified a sequence of computations by which amygdala neurons implemented view-based decision making and eventually recovered the chosen object's identity when the monkeys acted on their choice. These findings reveal a neural mechanism in the amygdala that derives object choices from abstract, view-based computations, suggesting an efficient solution for decision problems with many objects.

From signals to music: a bottom-up approach to the structure of neuronal activity.

Introduction: The search for the "neural code" has been a fundamental quest in neuroscience, concerned with the way neurons and neuronal systems process and transmit information. However, the term "code" has been mostly used as a metaphor, seldom acknowledging the formal definitions introduced by information theory, and the contributions of linguistics and semiotics not at all. The heuristic potential of the latter was suggested by structuralism, which turned the methods and findings of linguistics to other fields of knowledge. For the study of complex communication systems, such as human language and music, the necessity of an approach that considers multilayered, nested, structured organization of symbols becomes evident. We work under the hypothesis that the neural code might be as complex as these human-made codes. To test this, we propose a bottom-up approach, constructing a symbolic logic in order to translate neuronal signals into music scores. Methods: We recorded single cells' activity from the rat's globus pallidus pars interna under conditions of full alertness, blindfoldedness and environmental silence. We analyzed the signals with statistical, spectral, and complex methods, including Fast Fourier Transform, Hurst exponent and recurrence plot analysis. Results: The results indicated complex behavior and recurrence graphs consistent with fractality, and a Hurst exponent >0.5, evidencing temporal persistence. On the whole, these features point toward a complex behavior of the time series analyzed, also present in classical music, which upholds the hypothesis of structural similarities between music and neuronal activity. Furthermore, through our experiment we performed a comparison between music and raw neuronal activity. Our results point to the same conclusion, showing the structures of music and neuronal activity to be homologous. The scores were not only spontaneously tonal, but they exhibited structure and features normally present in human-made musical creations. Discussion: The hypothesis of a structural homology between the neural code and the code of music holds, suggesting that some of the insights introduced by linguistic and semiotic theory might be a useful methodological resource to go beyond the limits set by metaphoric notions of "code."

Neural coding of numerousness.

Perception of numerousness, i.e. number of items in a set, is an important cognitive ability, which is present in several animal taxa. In spite of obvious differences in neuroanatomy, insects, fishes, reptiles, birds, and mammals all possess a "number sense". Furthermore, information regarding numbers can belong to different sensory modalities: animals can estimate a number of visual items, a number of tones, or a number of their own movements. Given both the heterogeneity of stimuli and of the brains processing these stimuli, it is hard to imagine that number cognition can be traced back to the same evolutionary conserved neural pathway. However, neurons that selectively respond to the number of stimuli have been described in higher-order integration brain centres both in primates and in birds, two evolutionary distant groups. Although most probably not of the same evolutionary origin, these number neurons share remarkable similarities in their response properties. Instead of homology, this similarity might result from computational advantages of the underlying coding mechanism. This means that one might expect numerousness information to undergo similar steps of neural processing even in evolutionary distant neural pathways. Following this logic, in this review we summarize our current knowledge of how numerousness is processed in the brain from sensory input to coding of abstract information in the higher-order integration centres. We also propose a list of key open questions that might promote future research on number cognition.

Sparse ensemble neural code for a complete vocal repertoire.

The categorization of animal vocalizations into distinct behaviorally relevant groups for communication is an essential operation that must be performed by the auditory system. This auditory object recognition is a difficult task that requires selectivity to the group identifying acoustic features and invariance to renditions within each group. We find that small ensembles of auditory neurons in the forebrain of a social songbird can code the bird's entire vocal repertoire (∼10 call types). Ensemble neural discrimination is not, however, correlated with single unit selectivity, but instead with how well the joint single unit tunings to characteristic spectro-temporal modulations span the acoustic subspace optimized for the discrimination of call types. Thus, akin to face recognition in the visual system, call type recognition in the auditory system is based on a sparse code representing a small number of high-level features and not on highly selective grandmother neurons.

New insights on single-neuron selectivity in the era of population-level approaches.

In the past, neuroscience was focused on individual neurons seen as the functional units of the nervous system, but this approach fell short over time to account for new experimental evidence, especially for what concerns associative and motor cortices. For this reason and thanks to great technological advances, a part of modern research has shifted the focus from the responses of single neurons to the activity of neural ensembles, now considered the real functional units of the system. However, on a microscale, individual neurons remain the computational components of these networks, thus the study of population dynamics cannot prescind from studying also individual neurons which represent their natural substrate. In this new framework, ideas such as the capability of single cells to encode a specific stimulus (neural selectivity) may become obsolete and need to be profoundly revised. One step in this direction was made by introducing the concept of "mixed selectivity," the capacity of single cells to integrate multiple variables in a flexible way, allowing individual neurons to participate in different networks. In this review, we outline the most important features of mixed selectivity and we also present recent works demonstrating its presence in the associative areas of the posterior parietal cortex. Finally, in discussing these findings, we present some open questions that could be addressed by future studies.

Spatial representation by ramping activity of neurons in the retrohippocampal cortex.

Neurons in the retrohippocampal cortices play crucial roles in spatial memory. Many retrohippocampal neurons have firing fields that are selectively active at specific locations, with memory for rewarded locations associated with reorganization of these firing fields. Whether this is the sole strategy for representing spatial memories is unclear. Here, we demonstrate that during a spatial memory task retrohippocampal neurons encode location through ramping activity that extends across segments of a linear track approaching and following a reward, with the rewarded location represented by offsets or switches in the slope of the ramping activity. Ramping representations could be maintained independently of trial outcome and cues marking the reward location, indicating that they result from recall of the track structure. When recorded in an open arena, neurons that generated ramping activity during the spatial memory task were more numerous than grid or border cells, with a majority showing spatial firing that did not meet criteria for classification as grid or border representations. Encoding of rewarded locations through offsets and switches in the slope of ramping activity also emerged in recurrent neural network models trained to solve a similar spatial memory task. Impaired performance of model networks following disruption of outputs from ramping neurons is consistent with this coding strategy supporting navigation to recalled locations of behavioral significance. Our results suggest that encoding of learned spaces by retrohippocampal networks employs both discrete firing fields and continuous ramping representations. We hypothesize that retrohippocampal ramping activity mediates readout of learned models for goal-directed navigation.

Retinal Encoding of Natural Scenes.

An ultimate goal in retina science is to understand how the neural circuit of the retina processes natural visual scenes. Yet most studies in laboratories have long been performed with simple, artificial visual stimuli such as full-field illumination, spots of light, or gratings. The underlying assumption is that the features of the retina thus identified carry over to the more complex scenario of natural scenes. As the application of corresponding natural settings is becoming more commonplace in experimental investigations, this assumption is being put to the test and opportunities arise to discover processing features that are triggered by specific aspects of natural scenes. Here, we review how natural stimuli have been used to probe, refine, and complement knowledge accumulated under simplified stimuli, and we discuss challenges and opportunities along the way toward a comprehensive understanding of the encoding of natural scenes.

Comparing Surrogates to Evaluate Precisely Timed Higher-Order Spike Correlations.

The generation of surrogate data, i.e., the modification of data to destroy a certain feature, can be considered as the implementation of a null-hypothesis whenever an analytical approach is not feasible. Thus, surrogate data generation has been extensively used to assess the significance of spike correlations in parallel spike trains. In this context, one of the main challenges is to properly construct the desired null-hypothesis distribution and to avoid altering the single spike train statistics. A classical surrogate technique is uniform dithering (UD), which displaces spikes locally and uniformly distributed, to destroy temporal properties on a fine timescale while keeping them on a coarser one. Here, we compare UD against five similar surrogate techniques in the context of the detection of significant spatiotemporal spike patterns. We evaluate the surrogates for their performance, first on spike trains based on point process models with constant firing rate, and second on modeled nonstationary artificial data to assess the potential detection of false positive (FP) patterns in a more complex and realistic setting. We determine which statistical features of the spike trains are modified and to which extent. Moreover, we find that UD fails as an appropriate surrogate because it leads to a loss of spikes in the context of binning and clipping, and thus to a large number of FP patterns. The other surrogates achieve a better performance in detecting precisely timed higher-order correlations. Based on these insights, we analyze experimental data from the pre-/motor cortex of macaque monkeys during a reaching-and-grasping task.

Distinct neural codes in primate hippocampus and lateral prefrontal cortex during associative learning in virtual environments.

The hippocampus (HPC) and the lateral prefrontal cortex (LPFC) are two cortical areas of the primate brain deemed essential to cognition. Here, we hypothesized that the codes mediating neuronal communication in the HPC and LPFC microcircuits have distinctively evolved to serve plasticity and memory function at different spatiotemporal scales. We used a virtual reality task in which animals selected one of the two targets in the arms of the maze, according to a learned context-color rule. Our results show that during associative learning, HPC principal cells concentrate spikes in bursts, enabling temporal summation and fast synaptic plasticity in small populations of neurons and ultimately facilitating rapid encoding of associative memories. On the other hand, layer II/III LPFC pyramidal cells fire spikes more sparsely distributed over time. The latter would facilitate broadcasting of signals loaded in short-term memory across neuronal populations without necessarily triggering fast synaptic plasticity.

Disrupted population coding in the prefrontal cortex underlies pain aversion.

The prefrontal cortex (PFC) regulates a wide range of sensory experiences. Chronic pain is known to impair normal neural response, leading to enhanced aversion. However, it remains unknown how nociceptive responses in the cortex are processed at the population level and whether such processes are disrupted by chronic pain. Using in vivo endoscopic calcium imaging, we identify increased population activity in response to noxious stimuli and stable patterns of functional connectivity among neurons in the prelimbic (PL) PFC from freely behaving rats. Inflammatory pain disrupts functional connectivity of PFC neurons and reduces the overall nociceptive response. Interestingly, ketamine, a well-known neuromodulator, restores the functional connectivity among PL-PFC neurons in the inflammatory pain model to produce anti-aversive effects. These results suggest a dynamic resource allocation mechanism in the prefrontal representations of pain and indicate that population activity in the PFC critically regulates pain and serves as an important therapeutic target.

Effects of receptor density on the tactile perception of roughness: implications for neural mechanisms of texture perception.

Aim of the study: The purpose of this study was to investigate the effects of receptor density in the glabrous skin of the hand on the perception of the roughness of a textured surface.Materials and methods: This was done by having observers make magnitude estimates of the perceived roughness of raised-dot surfaces at the fingertip, with its high receptor density, and the thenar eminence, with its much lower receptor density.Results: Judgments of perceived roughness averaged over the inter-dot spacings (0.8-5.9 mm) employed in the study did not differ significantly between the two sites, which suggested that roughness perception is not exclusively dependent upon a neural code involving variation in the activity levels of the nerve fibers of spatially distributed receptors, as is the case in spatial discrimination tasks such as spatial-gap detection, grove-orientation discrimination and letter recognition. This hypothesis was further supported by the finding that the elimination of temporal cues by preventing movement of the skin over the raised-dot surface drastically impaired judgments of perceived roughness at the thenar but had little effect on judgments of perceived roughness at the fingertip.Conclusion: These findings suggested that the neural code for perceived roughness at the fingertip is mediated primarily by spatial variation in the activity levels of spatially distributed receptors whereas the neural code for perceived roughness at the thenar is mediated primarily by temporal variation in the activity levels of individual receptors.

Oculo-retinal dynamics can explain the perception of minimal recognizable configurations.

Natural vision is a dynamic and continuous process. Under natural conditions, visual object recognition typically involves continuous interactions between ocular motion and visual contrasts, resulting in dynamic retinal activations. In order to identify the dynamic variables that participate in this process and are relevant for image recognition, we used a set of images that are just above and below the human recognition threshold and whose recognition typically requires >2 s of viewing. We recorded eye movements of participants while attempting to recognize these images within trials lasting 3 s. We then assessed the activation dynamics of retinal ganglion cells resulting from ocular dynamics using a computational model. We found that while the saccadic rate was similar between recognized and unrecognized trials, the fixational ocular speed was significantly larger for unrecognized trials. Interestingly, however, retinal activation level was significantly lower during these unrecognized trials. We used retinal activation patterns and oculomotor parameters of each fixation to train a binary classifier, classifying recognized from unrecognized trials. Only retinal activation patterns could predict recognition, reaching 80% correct classifications on the fourth fixation (on average, ∼2.5 s from trial onset). We thus conclude that the information that is relevant for visual perception is embedded in the dynamic interactions between the oculomotor sequence and the image. Hence, our results suggest that ocular dynamics play an important role in recognition and that understanding the dynamics of retinal activation is crucial for understanding natural vision.

Neural activity temporal pattern dictates long-range propagation targets.

Brain possesses a complex spatiotemporal architecture for efficient information processing and computing. However, it remains unknown how neural signal propagates to its intended targets brain-wide. Using optogenetics and functional MRI, we arbitrarily initiated various discrete neural activity pulse trains with different temporal patterns and revealed their distinct long-range propagation targets within the well-defined, topographically organized somatosensory thalamo-cortical circuit. We further observed that such neural activity propagation over long range could modulate brain-wide sensory functions. Electrophysiological analysis indicated that distinct propagation pathways arose from system level neural adaptation and facilitation in response to the neural activity temporal characteristics. Together, our findings provide fundamental insights into the long-range information transfer and processing. They directly support that temporal coding underpins the whole brain functional architecture in presence of the vast and relatively static anatomical architecture.

Short-Term Synaptic Plasticity Makes Neurons Sensitive to the Distribution of Presynaptic Population Firing Rates.

The ability to discriminate spikes that encode a particular stimulus from spikes produced by background activity is essential for reliable information processing in the brain. We describe how synaptic short-term plasticity (STP) modulates the output of presynaptic populations as a function of the distribution of the spiking activity and find a strong relationship between STP features and sparseness of the population code, which could solve this problem. Furthermore, we show that feedforward excitation followed by inhibition (FF-EI), combined with target-dependent STP, promote substantial increase in the signal gain even for considerable deviations from the optimal conditions, granting robustness to this mechanism. A simulated neuron driven by a spiking FF-EI network is reliably modulated as predicted by a rate analysis and inherits the ability to differentiate sparse signals from dense background activity changes of the same magnitude, even at very low signal-to-noise conditions. We propose that the STP-based distribution discrimination is likely a latent function in several regions such as the cerebellum and the hippocampus.