Parallel and distributed encoding of speech across human auditory cortex.

Speech perception is thought to rely on a cortical feedforward serial transformation of acoustic into linguistic representations. Using intracranial recordings across the entire human auditory cortex, electrocortical stimulation, and surgical ablation, we show that cortical processing across areas is not consistent with a serial hierarchical organization. Instead, response latency and receptive field analyses demonstrate parallel and distinct information processing in the primary and nonprimary auditory cortices. This functional dissociation was also observed where stimulation of the primary auditory cortex evokes auditory hallucination but does not distort or interfere with speech perception. Opposite effects were observed during stimulation of nonprimary cortex in superior temporal gyrus. Ablation of the primary auditory cortex does not affect speech perception. These results establish a distributed functional organization of parallel information processing throughout the human auditory cortex and demonstrate an essential independent role for nonprimary auditory cortex in speech processing.

Insight into the Neuron's Insight.

In this issue, Ponce and colleagues use a generative closed-loop system to evolve synthetic images to explore the response properties of neurons in the inferior temporal cortex of non-human primates. The results reveal an unbiased assessment of feature selectivity in a high-level visual area involved in object recognition.

Evolving Images for Visual Neurons Using a Deep Generative Network Reveals Coding Principles and Neuronal Preferences.

What specific features should visual neurons encode, given the infinity of real-world images and the limited number of neurons available to represent them? We investigated neuronal selectivity in monkey inferotemporal cortex via the vast hypothesis space of a generative deep neural network, avoiding assumptions about features or semantic categories. A genetic algorithm searched this space for stimuli that maximized neuronal firing. This led to the evolution of rich synthetic images of objects with complex combinations of shapes, colors, and textures, sometimes resembling animals or familiar people, other times revealing novel patterns that did not map to any clear semantic category. These results expand our conception of the dictionary of features encoded in the cortex, and the approach can potentially reveal the internal representations of any system whose input can be captured by a generative model.

A Hippocampus-Accumbens Tripartite Neuronal Motif Guides Appetitive Memory in Space.

Retrieving and acting on memories of food-predicting environments are fundamental processes for animal survival. Hippocampal pyramidal cells (PYRs) of the mammalian brain provide mnemonic representations of space. Yet the substrates by which these hippocampal representations support memory-guided behavior remain unknown. Here, we uncover a direct connection from dorsal CA1 (dCA1) hippocampus to nucleus accumbens (NAc) that enables the behavioral manifestation of place-reward memories. By monitoring neuronal ensembles in mouse dCA1→NAc pathway, combined with cell-type selective optogenetic manipulations of input-defined postsynaptic neurons, we show that dCA1 PYRs drive NAc medium spiny neurons and orchestrate their spiking activity using feedforward inhibition mediated by dCA1-connected parvalbumin-expressing fast-spiking interneurons. This tripartite cross-circuit motif supports spatial appetitive memory and associated NAc assemblies, being independent of dorsal subiculum and dispensable for both spatial novelty detection and reward seeking. Our findings demonstrate that the dCA1→NAc pathway instantiates a limbic-motor interface for neuronal representations of space to promote effective appetitive behavior.

The Code for Facial Identity in the Primate Brain.

Primates recognize complex objects such as faces with remarkable speed and reliability. Here, we reveal the brain's code for facial identity. Experiments in macaques demonstrate an extraordinarily simple transformation between faces and responses of cells in face patches. By formatting faces as points in a high-dimensional linear space, we discovered that each face cell's firing rate is proportional to the projection of an incoming face stimulus onto a single axis in this space, allowing a face cell ensemble to encode the location of any face in the space. Using this code, we could precisely decode faces from neural population responses and predict neural firing rates to faces. Furthermore, this code disavows the long-standing assumption that face cells encode specific facial identities, confirmed by engineering faces with drastically different appearance that elicited identical responses in single face cells. Our work suggests that other objects could be encoded by analogous metric coordinate systems. PAPERCLIP.

Histone Acetylome-wide Association Study of Autism Spectrum Disorder.

The association of histone modification changes with autism spectrum disorder (ASD) has not been systematically examined. We conducted a histone acetylome-wide association study (HAWAS) by performing H3K27ac chromatin immunoprecipitation sequencing (ChIP-seq) on 257 postmortem samples from ASD and matched control brains. Despite etiological heterogeneity, ≥68% of syndromic and idiopathic ASD cases shared a common acetylome signature at >5,000 cis-regulatory elements in prefrontal and temporal cortex. Similarly, multiple genes associated with rare genetic mutations in ASD showed common "epimutations." Acetylome aberrations in ASD were not attributable to genetic differentiation at cis-SNPs and highlighted genes involved in synaptic transmission, ion transport, epilepsy, behavioral abnormality, chemokinesis, histone deacetylation, and immunity. By correlating histone acetylation with genotype, we discovered >2,000 histone acetylation quantitative trait loci (haQTLs) in human brain regions, including four candidate causal variants for psychiatric diseases. Due to the relative stability of histone modifications postmortem, we anticipate that the HAWAS approach will be applicable to multiple diseases.

Temporal multiplexing of perception and memory codes in IT cortex.

A central assumption of neuroscience is that long-term memories are represented by the same brain areas that encode sensory stimuli1. Neurons in inferotemporal (IT) cortex represent the sensory percept of visual objects using a distributed axis code2-4. Whether and how the same IT neural population represents the long-term memory of visual objects remains unclear. Here we examined how familiar faces are encoded in the IT anterior medial face patch (AM), perirhinal face patch (PR) and temporal pole face patch (TP). In AM and PR we observed that the encoding axis for familiar faces is rotated relative to that for unfamiliar faces at long latency; in TP this memory-related rotation was much weaker. Contrary to previous claims, the relative response magnitude to familiar versus unfamiliar faces was not a stable indicator of familiarity in any patch5-11. The mechanism underlying the memory-related axis change is likely intrinsic to IT cortex, because inactivation of PR did not affect axis change dynamics in AM. Overall, our results suggest that memories of familiar faces are represented in AM and perirhinal cortex by a distinct long-latency code, explaining how the same cell population can encode both the percept and memory of faces.

Large-scale single-neuron speech sound encoding across the depth of human cortex.

Understanding the neural basis of speech perception requires that we study the human brain both at the scale of the fundamental computational unit of neurons and in their organization across the depth of cortex. Here we used high-density Neuropixels arrays1-3 to record from 685 neurons across cortical layers at nine sites in a high-level auditory region that is critical for speech, the superior temporal gyrus4,5, while participants listened to spoken sentences. Single neurons encoded a wide range of speech sound cues, including features of consonants and vowels, relative vocal pitch, onsets, amplitude envelope and sequence statistics. Neurons at each cross-laminar recording exhibited dominant tuning to a primary speech feature while also containing a substantial proportion of neurons that encoded other features contributing to heterogeneous selectivity. Spatially, neurons at similar cortical depths tended to encode similar speech features. Activity across all cortical layers was predictive of high-frequency field potentials (electrocorticography), providing a neuronal origin for macroelectrode recordings from the cortical surface. Together, these results establish single-neuron tuning across the cortical laminae as an important dimension of speech encoding in human superior temporal gyrus.

Protracted neuronal recruitment in the temporal lobes of young children.

The temporal lobe of the human brain contains the entorhinal cortex (EC). This region of the brain is a highly interconnected integrative hub for sensory and spatial information; it also has a key role in episodic memory formation and is the main source of cortical hippocampal inputs1-4. The human EC continues to develop during childhood5, but neurogenesis and neuronal migration to the EC are widely considered to be complete by birth. Here we show that the human temporal lobe contains many young neurons migrating into the postnatal EC and adjacent regions, with a large tangential stream persisting until the age of around one year and radial dispersal continuing until around two to three years of age. By contrast, we found no equivalent postnatal migration in rhesus macaques (Macaca mulatta). Immunostaining and single-nucleus RNA sequencing of ganglionic eminence germinal zones, the EC stream and the postnatal EC revealed that most migrating cells in the EC stream are derived from the caudal ganglionic eminence and become LAMP5+RELN+ inhibitory interneurons. These late-arriving interneurons could continue to shape the processing of sensory and spatial information well into postnatal life, when children are actively interacting with their environment. The EC is one of the first regions of the brain to be affected in Alzheimer's disease, and previous work has linked cognitive decline to the loss of LAMP5+RELN+ cells6,7. Our investigation reveals that many of these cells arrive in the EC through a major postnatal migratory stream in early childhood.

Abstract representations emerge in human hippocampal neurons during inference.

Humans have the remarkable cognitive capacity to rapidly adapt to changing environments. Central to this capacity is the ability to form high-level, abstract representations that take advantage of regularities in the world to support generalization1. However, little is known about how these representations are encoded in populations of neurons, how they emerge through learning and how they relate to behaviour2,3. Here we characterized the representational geometry of populations of neurons (single units) recorded in the hippocampus, amygdala, medial frontal cortex and ventral temporal cortex of neurosurgical patients performing an inferential reasoning task. We found that only the neural representations formed in the hippocampus simultaneously encode several task variables in an abstract, or disentangled, format. This representational geometry is uniquely observed after patients learn to perform inference, and consists of disentangled directly observable and discovered latent task variables. Learning to perform inference by trial and error or through verbal instructions led to the formation of hippocampal representations with similar geometric properties. The observed relation between representational format and inference behaviour suggests that abstract and disentangled representational geometries are important for complex cognition.

Control of working memory by phase-amplitude coupling of human hippocampal neurons.

Retaining information in working memory is a demanding process that relies on cognitive control to protect memoranda-specific persistent activity from interference1,2. However, how cognitive control regulates working memory storage is unclear. Here we show that interactions of frontal control and hippocampal persistent activity are coordinated by theta-gamma phase-amplitude coupling (TG-PAC). We recorded single neurons in the human medial temporal and frontal lobe while patients maintained multiple items in their working memory. In the hippocampus, TG-PAC was indicative of working memory load and quality. We identified cells that selectively spiked during nonlinear interactions of theta phase and gamma amplitude. The spike timing of these PAC neurons was coordinated with frontal theta activity when cognitive control demand was high. By introducing noise correlations with persistently active neurons in the hippocampus, PAC neurons shaped the geometry of the population code. This led to higher-fidelity representations of working memory content that were associated with improved behaviour. Our results support a multicomponent architecture of working memory1,2, with frontal control managing maintenance of working memory content in storage-related areas3-5. Within this framework, hippocampal TG-PAC integrates cognitive control and working memory storage across brain areas, thereby suggesting a potential mechanism for top-down control over sensory-driven processes.

Neural signatures of natural behaviour in socializing macaques.

Our understanding of the neurobiology of primate behaviour largely derives from artificial tasks in highly controlled laboratory settings, overlooking most natural behaviours that primate brains evolved to produce1-3. How primates navigate the multidimensional social relationships that structure daily life4 and shape survival and reproductive success5 remains largely unclear at the single-neuron level. Here we combine ethological analysis, computer vision and wireless recording technologies to identify neural signatures of natural behaviour in unrestrained, socially interacting pairs of rhesus macaques. Single-neuron and population activity in the prefrontal and temporal cortex robustly encoded 24 species-typical behaviours, as well as social context. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioural mechanism supporting friendships and alliances6, and neural activity maintained a running account of these social investments. Confronted with an aggressive intruder, behavioural and neural population responses reflected empathy and were buffered by the presence of a partner. Our findings reveal a highly distributed neurophysiological ledger of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

TAF15 amyloid filaments in frontotemporal lobar degeneration.

Frontotemporal lobar degeneration (FTLD) causes frontotemporal dementia (FTD), the most common form of dementia after Alzheimer's disease, and is often also associated with motor disorders1. The pathological hallmarks of FTLD are neuronal inclusions of specific, abnormally assembled proteins2. In the majority of cases the inclusions contain amyloid filament assemblies of TAR DNA-binding protein 43 (TDP-43) or tau, with distinct filament structures characterizing different FTLD subtypes3,4. The presence of amyloid filaments and their identities and structures in the remaining approximately 10% of FTLD cases are unknown but are widely believed to be composed of the protein fused in sarcoma (FUS, also known as translocated in liposarcoma). As such, these cases are commonly referred to as FTLD-FUS. Here we used cryogenic electron microscopy (cryo-EM) to determine the structures of amyloid filaments extracted from the prefrontal and temporal cortices of four individuals with FTLD-FUS. Surprisingly, we found abundant amyloid filaments of the FUS homologue TATA-binding protein-associated factor 15 (TAF15, also known as TATA-binding protein-associated factor 2N) rather than of FUS itself. The filament fold is formed from residues 7-99 in the low-complexity domain (LCD) of TAF15 and was identical between individuals. Furthermore, we found TAF15 filaments with the same fold in the motor cortex and brainstem of two of the individuals, both showing upper and lower motor neuron pathology. The formation of TAF15 amyloid filaments with a characteristic fold in FTLD establishes TAF15 proteinopathy in neurodegenerative disease. The structure of TAF15 amyloid filaments provides a basis for the development of model systems of neurodegenerative disease, as well as for the design of diagnostic and therapeutic tools targeting TAF15 proteinopathy.

A highly conserved program of neuronal microexons is misregulated in autistic brains.

Alternative splicing (AS) generates vast transcriptomic and proteomic complexity. However, which of the myriad of detected AS events provide important biological functions is not well understood. Here, we define the largest program of functionally coordinated, neural-regulated AS described to date in mammals. Relative to all other types of AS within this program, 3-15 nucleotide "microexons" display the most striking evolutionary conservation and switch-like regulation. These microexons modulate the function of interaction domains of proteins involved in neurogenesis. Most neural microexons are regulated by the neuronal-specific splicing factor nSR100/SRRM4, through its binding to adjacent intronic enhancer motifs. Neural microexons are frequently misregulated in the brains of individuals with autism spectrum disorder, and this misregulation is associated with reduced levels of nSR100. The results thus reveal a highly conserved program of dynamic microexon regulation associated with the remodeling of protein-interaction networks during neurogenesis, the misregulation of which is linked to autism.

Robust Hi-C Maps of Enhancer-Promoter Interactions Reveal the Function of Non-coding Genome in Neural Development and Diseases.

Genome-wide mapping of chromatin interactions at high resolution remains experimentally and computationally challenging. Here we used a low-input "easy Hi-C" protocol to map the 3D genome architecture in human neurogenesis and brain tissues and also demonstrated that a rigorous Hi-C bias-correction pipeline (HiCorr) can significantly improve the sensitivity and robustness of Hi-C loop identification at sub-TAD level, especially the enhancer-promoter (E-P) interactions. We used HiCorr to compare the high-resolution maps of chromatin interactions from 10 tissue or cell types with a focus on neurogenesis and brain tissues. We found that dynamic chromatin loops are better hallmarks for cellular differentiation than compartment switching. HiCorr allowed direct observation of cell-type- and differentiation-specific E-P aggregates spanning large neighborhoods, suggesting a mechanism that stabilizes enhancer contacts during development. Interestingly, we concluded that Hi-C loop outperforms eQTL in explaining neurological GWAS results, revealing a unique value of high-resolution 3D genome maps in elucidating the disease etiology.

The anterior thalamic nuclei: core components of a tripartite episodic memory system.

Standard models of episodic memory focus on hippocampal-parahippocampal interactions, with the neocortex supplying sensory information and providing a final repository of mnemonic representations. However, recent advances have shown that other regions make distinct and equally critical contributions to memory. In particular, there is growing evidence that the anterior thalamic nuclei have a number of key cognitive functions that support episodic memory. In this article, we describe these findings and argue for a core, tripartite memory system, comprising a 'temporal lobe' stream (centred on the hippocampus) and a 'medial diencephalic' stream (centred on the anterior thalamic nuclei) that together act on shared cortical areas. We demonstrate how these distributed brain regions form complementary and necessary partnerships in episodic memory formation.

Cross-frequency coupling in cortico-hippocampal networks supports the maintenance of sequential auditory information in short-term memory.

It has been suggested that cross-frequency coupling in cortico-hippocampal networks enables the maintenance of multiple visuo-spatial items in working memory. However, whether this mechanism acts as a global neural code for memory retention across sensory modalities remains to be demonstrated. Intracranial EEG data were recorded while drug-resistant patients with epilepsy performed a delayed matched-to-sample task with tone sequences. We manipulated task difficulty by varying the memory load and the duration of the silent retention period between the to-be-compared sequences. We show that the strength of theta-gamma phase amplitude coupling in the superior temporal sulcus, the inferior frontal gyrus, the inferior temporal gyrus, and the hippocampus (i) supports the short-term retention of auditory sequences; (ii) decodes correct and incorrect memory trials as revealed by machine learning analysis; and (iii) is positively correlated with individual short-term memory performance. Specifically, we show that successful task performance is associated with consistent phase coupling in these regions across participants, with gamma bursts restricted to specific theta phase ranges corresponding to higher levels of neural excitability. These findings highlight the role of cortico-hippocampal activity in auditory short-term memory and expand our knowledge about the role of cross-frequency coupling as a global biological mechanism for information processing, integration, and memory in the human brain.

Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response.

Behavioral and neuroscience studies in humans and primates have shown that memorability is an intrinsic property of an image that predicts its strength of encoding into and retrieval from memory. While previous work has independently probed when or where this memorability effect may occur in the human brain, a description of its spatiotemporal dynamics is missing. Here, we used representational similarity analysis (RSA) to combine functional magnetic resonance imaging (fMRI) with source-estimated magnetoencephalography (MEG) to simultaneously measure when and where the human cortex is sensitive to differences in image memorability. Results reveal that visual perception of High Memorable images, compared to Low Memorable images, recruits a set of regions of interest (ROIs) distributed throughout the ventral visual cortex: a late memorability response (from around 300 ms) in early visual cortex (EVC), inferior temporal cortex, lateral occipital cortex, fusiform gyrus, and banks of the superior temporal sulcus. Image memorability magnitude results are represented after high-level feature processing in visual regions and reflected in classical memory regions in the medial temporal lobe (MTL). Our results present, to our knowledge, the first unified spatiotemporal account of visual memorability effect across the human cortex, further supporting the levels-of-processing theory of perception and memory.

Large-scale cellular-resolution gene profiling in human neocortex reveals species-specific molecular signatures.

Although there have been major advances in elucidating the functional biology of the human brain, relatively little is known of its cellular and molecular organization. Here we report a large-scale characterization of the expression of ∼1,000 genes important for neural functions by in situ hybridization at a cellular resolution in visual and temporal cortices of adult human brains. These data reveal diverse gene expression patterns and remarkable conservation of each individual gene's expression among individuals (95%), cortical areas (84%), and between human and mouse (79%). A small but substantial number of genes (21%) exhibited species-differential expression. Distinct molecular signatures, comprised of genes both common between species and unique to each, were identified for each major cortical cell type. The data suggest that gene expression profile changes may contribute to differential cortical function across species, and in particular, a shift from corticosubcortical to more predominant corticocortical communications in the human brain.

Boundary-anchored neural mechanisms of location-encoding for self and others.

Everyday tasks in social settings require humans to encode neural representations of not only their own spatial location, but also the location of other individuals within an environment. At present, the vast majority of what is known about neural representations of space for self and others stems from research in rodents and other non-human animals1-3. However, it is largely unknown how the human brain represents the location of others, and how aspects of human cognition may affect these location-encoding mechanisms. To address these questions, we examined individuals with chronically implanted electrodes while they carried out real-world spatial navigation and observation tasks. We report boundary-anchored neural representations in the medial temporal lobe that are modulated by one's own as well as another individual's spatial location. These representations depend on one's momentary cognitive state, and are strengthened when encoding of location is of higher behavioural relevance. Together, these results provide evidence for a common encoding mechanism in the human brain that represents the location of oneself and others in shared environments, and shed new light on the neural mechanisms that underlie spatial navigation and awareness of others in real-world scenarios.