Encoding of 3D physical dimensions by face-selective cortical neurons.

Neurons throughout the primate inferior temporal (IT) cortex respond selectively to visual images of faces and other complex objects. The response magnitude of neurons to a given image often depends on the size at which the image is presented, usually on a flat display at a fixed distance. While such size sensitivity might simply reflect the angular subtense of retinal image stimulation in degrees, one unexplored possibility is that it tracks the real-world geometry of physical objects, such as their size and distance to the observer in centimeters. This distinction bears fundamentally on the nature of object representation in IT and on the scope of visual operations supported by the ventral visual pathway. To address this question, we assessed the response dependency of neurons in the macaque anterior fundus (AF) face patch to the angular versus physical size of faces. We employed a macaque avatar to stereoscopically render three-dimensional (3D) photorealistic faces at multiple sizes and distances, including a subset of size/distance combinations designed to cast the same size retinal image projection. We found that most AF neurons were modulated principally by the 3D physical size of the face rather than its two-dimensional (2D) angular size on the retina. Further, most neurons responded strongest to extremely large and small faces, rather than to those of normal size. Together, these findings reveal a graded encoding of physical size among face patch neurons, providing evidence that category-selective regions of the primate ventral visual pathway participate in a geometric analysis of real-world objects.

Central visual pathways affected by degenerative retinal disease before and after gene therapy.

Genetic diseases affecting the retina can result in partial or complete loss of visual function. Leber's Congenital Amaurosis (LCA) is a rare blinding disease, usually inherited in an autosomally recessive manner, with no cure. Retinal gene therapy has been shown to improve vision in LCA patients caused by mutations in the RPE65 gene (LCA2). However, little is known about how activity in central visual pathways is affected by the disease or by subsequent gene therapy. Functional MRI was used to assess retinal signal transmission in cortical and subcortical visual structures before and one year after retinal intervention. The fMRI paradigm consisted of 15-second blocks of flickering (8-Hz) black and white checkerboards interleaved with 15 seconds of blank (black) screen. Visual activation in the brain was assessed using the general linear model, with multiple comparisons corrected using the false discovery rate method. Response to visual stimulation through untreated eyes of LCA2 patients showed heightened fMRI responses in the superior colliculus (SC) and diminished activities in the lateral geniculate nucleus (LGN) compared to controls, indicating a shift in the patients' visual processing towards the retinotectal pathway (RT). Following gene therapy, stimuli presented to the treated eye elicited significantly stronger fMRI responses in the LGN and primary visual cortex, indicating some reengagement of the geniculostriate pathway (GS) pathway. Across patients, the post-treatment LGN fMRI responses correlated significantly with performance on a clinical test measuring light sensitivity. Our results demonstrate that the low vision observed in LCA2 patients involves a shift in visual processing toward the retinotectal pathway, and that gene therapy partially reinstates visual transmission through the GS pathway. This selective boosting of retinal output through the GS pathway and its correlation to improved visual performance, following several years of degenerative retinal disease, is striking. However, while retinal gene therapy and other ocular interventions have given hope to RPE65 patients, it may take years before development of therapies tailored to treat the diseases in other low vision patients are available. Our demonstration of a shift toward the RT pathway in these patients may spur the development of new tools and rehabilitation strategies to help maximize the use of residual visual abilities and augment experience-dependent plasticity.

Brain-wide functional connectivity of face patch neurons during rest.

The brain is a highly organized, dynamic system whose network architecture is often assessed through resting functional magnetic resonance imaging (fMRI) functional connectivity. The functional interactions between brain areas, including those observed during rest, are assumed to stem from the collective influence of action potentials carried by long-range neural projections. However, the contribution of individual neurons to brain-wide functional connectivity has not been systematically assessed. Here we developed a method to concurrently measure and compare the spiking activity of local neurons with fMRI signals measured across the brain during rest. We recorded spontaneous activity from neural populations in cortical face patches in the macaque during fMRI scanning sessions. Individual cells exhibited prominent, bilateral coupling with fMRI fluctuations in a restricted set of cortical areas inside and outside the face patch network, partially matching the pattern of known anatomical projections. Within each face patch population, a subset of neurons was positively coupled with the face patch network and another was negatively coupled. The same cells showed inverse correlations with distinct subcortical structures, most notably the lateral geniculate nucleus and brainstem neuromodulatory centers. Corresponding connectivity maps derived from fMRI seeds and local field potentials differed from the single unit maps, particularly in subcortical areas. Together, the results demonstrate that the spiking fluctuations of neurons are selectively coupled with discrete brain regions, with the coupling governed in part by anatomical network connections and in part by indirect neuromodulatory pathways.

Single-neuron firing cascades underlie global spontaneous brain events.

The resting brain consumes enormous energy and shows highly organized spontaneous activity. To investigate how this activity is manifest among single neurons, we analyzed spiking discharges of ∼10,000 isolated cells recorded from multiple cortical and subcortical regions of the mouse brain during immobile rest. We found that firing of a significant proportion (∼70%) of neurons conformed to a ubiquitous, temporally sequenced cascade of spiking that was synchronized with global events and elapsed over timescales of 5 to 10 s. Across the brain, two intermixed populations of neurons supported orthogonal cascades. The relative phases of these cascades determined, at each moment, the response magnitude evoked by an external visual stimulus. Furthermore, the spiking of individual neurons embedded in these cascades was time locked to physiological indicators of arousal, including local field potential power, pupil diameter, and hippocampal ripples. These findings demonstrate that the large-scale coordination of low-frequency spontaneous activity, which is commonly observed in brain imaging and linked to arousal, sensory processing, and memory, is underpinned by sequential, large-scale temporal cascades of neuronal spiking across the brain.

Failure to engage the temporoparietal junction/posterior superior temporal sulcus predicts impaired naturalistic social cognition in schizophrenia.

Schizophrenia is associated with marked impairments in social cognition. However, the neural correlates of these deficits remain unclear. Here we use naturalistic stimuli to examine the role of the right temporoparietal junction/posterior superior temporal sulcus (TPJ-pSTS)-an integrative hub for the cortical networks pertinent to the understanding complex social situations-in social inference, a key component of social cognition, in schizophrenia. Twenty-seven schizophrenia participants and 21 healthy control subjects watched a clip of the film The Good, the Bad and the Ugly while high resolution multiband functional MRI images were collected. We used inter-subject correlation to measure the evoked activity, which we then compared to social cognition as measured by The Awareness of Social Inference Test (TASIT). We also compared between groups the TPJ-pSTS blood oxygen level-dependent activity (i) relationship with the motion content in the film; (ii) synchronization with other cortical areas involved in the viewing of the movie; and (iii) relationship with the frequency of saccades made during the movie. Activation deficits were greatest in middle TPJ (TPJm) and correlated significantly with impaired TASIT performance across groups. Follow-up analyses of the TPJ-pSTS revealed decreased synchronization with other cortical areas, decreased correlation with the motion content of the movie, and decreased correlation with the saccades made during the movie. The functional impairment of the TPJm, a hub area in the middle of the TPJ-pSTS, predicts deficits in social inference in schizophrenia participants by disrupting the integration of visual motion processing into the TPJ. This disrupted integration then affects the use of the TPJ to guide saccades during the visual scanning of the movie clip. These findings suggest that the TPJ may be a treatment target for improving deficits in a key component of social cognition in schizophrenia participants.

Brain Activity Fluctuations Propagate as Waves Traversing the Cortical Hierarchy.

The brain exhibits highly organized patterns of spontaneous activity as measured by resting-state functional magnetic resonance imaging (fMRI) fluctuations that are being widely used to assess the brain's functional connectivity. Some evidence suggests that spatiotemporally coherent waves are a core feature of spontaneous activity that shapes functional connectivity, although this has been difficult to establish using fMRI given the temporal constraints of the hemodynamic signal. Here, we investigated the structure of spontaneous waves in human fMRI and monkey electrocorticography. In both species, we found clear, repeatable, and directionally constrained activity waves coursed along a spatial axis approximately representing cortical hierarchical organization. These cortical propagations were closely associated with activity changes in distinct subcortical structures, particularly those related to arousal regulation, and modulated across different states of vigilance. The findings demonstrate a neural origin of spatiotemporal fMRI wave propagation at rest and link it to the principal gradient of resting-state fMRI connectivity.

Parallel Processing of Facial Expression and Head Orientation in the Macaque Brain.

When we move the features of our face, or turn our head, we communicate changes in our internal state to the people around us. How this information is encoded and used by an observer's brain is poorly understood. We investigated this issue using a functional MRI adaptation paradigm in awake male macaques. Among face-selective patches of the superior temporal sulcus (STS), we found a double dissociation of areas processing facial expression and those processing head orientation. The face-selective patches in the STS fundus were most sensitive to facial expression, as was the amygdala, whereas those on the lower, lateral edge of the sulcus were most sensitive to head orientation. The results of this study reveal a new dimension of functional organization, with face-selective patches segregating within the STS. The findings thus force a rethinking of the role of the face-processing system in representing subject-directed actions and supporting social cognition.SIGNIFICANCE STATEMENT When we are interacting with another person, we make inferences about their emotional state based on visual signals. For example, when a person's facial expression changes, we are given information about their feelings. While primates are thought to have specialized cortical mechanisms for analyzing the identity of faces, less is known about how these mechanisms unpack transient signals, like expression, that can change from one moment to the next. Here, using an fMRI adaptation paradigm, we demonstrate that while the identity of a face is held constant, there are separate mechanisms in the macaque brain for processing transient changes in the face's expression and orientation. These findings shed new light on the function of the face-processing system during social exchanges.

Visualization of iron-rich subcortical structures in non-human primates in vivo by quantitative susceptibility mapping at 3T MRI.

Magnetic resonance imaging (MRI) is now an essential tool in the field of neuroscience involving non-human primates (NHP). Structural MRI scanning using T1-weighted (T1w) or T2-weighted (T2w) images provides anatomical information, particularly for experiments involving deep structures such as the basal ganglia and cerebellum. However, for certain subcortical structures, T1w and T2w image contrasts are insufficient for their detection of important anatomical details. To better visualize such structures in the macaque brain, we applied a relatively new method called quantitative susceptibility mapping (QSM), which enhances tissue contrast based on the local tissue magnetic susceptibility. The QSM significantly improved the visualization of important structures, including the ventral pallidum (VP), globus pallidus external and internal segments (GPe and GPi), substantia nigra (SN), subthalamic nucleus (STN) in the basal ganglia and the dentate nucleus (DN) in the cerebellum. We quantified this the contrast enhancement by systematically comparing of contrast-to-noise ratios (CNRs) of QSM images relative to the corresponding T1w and T2w images. In addition, QSM values of some structures were correlated to the age of the macaque subjects. These results identify the QSM method as a straightforward and useful tool for clearly visualizing details of subcortical structures that are invisible with more traditional scanning sequences.

What you see is what you get: visual scanning failures of naturalistic social scenes in schizophrenia.

BACKGROUND: Impairments in social cognition contribute significantly to disability in schizophrenia patients (SzP). Perception of facial expressions is critical for social cognition. Intact perception requires an individual to visually scan a complex dynamic social scene for transiently moving facial expressions that may be relevant for understanding the scene. The relationship of visual scanning for these facial expressions and social cognition remains unknown. METHODS: In 39 SzP and 27 healthy controls (HC), we used eye-tracking to examine the relationship between performance on The Awareness of Social Inference Test (TASIT), which tests social cognition using naturalistic video clips of social situations, and visual scanning, measuring each individual's relative to the mean of HC. We then examined the relationship of visual scanning to the specific visual features (motion, contrast, luminance, faces) within the video clips. RESULTS: TASIT performance was significantly impaired in SzP for trials involving sarcasm (p < 10-5). Visual scanning was significantly more variable in SzP than HC (p < 10-6), and predicted TASIT performance in HC (p = 0.02) but not SzP (p = 0.91), differing significantly between groups (p = 0.04). During the visual scanning, SzP were less likely to be viewing faces (p = 0.0001) and less likely to saccade to facial motion in peripheral vision (p = 0.008). CONCLUSIONS: SzP show highly significant deficits in the use of visual scanning of naturalistic social scenes to inform social cognition. Alterations in visual scanning patterns may originate from impaired processing of facial motion within peripheral vision. Overall, these results highlight the utility of naturalistic stimuli in the study of social cognition deficits in schizophrenia.

Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory.

Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object-value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward ("good" stimuli) elicited elevated fMRI responses compared with those associated with low reward ("bad" stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal-prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal-prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.

Transient visual pathway critical for normal development of primate grasping behavior.

An evolutionary hallmark of anthropoid primates, including humans, is the use of vision to guide precise manual movements. These behaviors are reliant on a specialized visual input to the posterior parietal cortex. Here, we show that normal primate reaching-and-grasping behavior depends critically on a visual pathway through the thalamic pulvinar, which is thought to relay information to the middle temporal (MT) area during early life and then swiftly withdraws. Small MRI-guided lesions to a subdivision of the inferior pulvinar subnucleus (PIm) in the infant marmoset monkey led to permanent deficits in reaching-and-grasping behavior in the adult. This functional loss coincided with the abnormal anatomical development of multiple cortical areas responsible for the guidance of actions. Our study reveals that the transient retino-pulvinar-MT pathway underpins the development of visually guided manual behaviors in primates that are crucial for interacting with complex features in the environment.

Studying the visual brain in its natural rhythm.

How the brain fluidly orchestrates visual behavior is a central question in cognitive neuroscience. Researchers studying neural responses in humans and nonhuman primates have mapped out visual response profiles and cognitive modulation in a large number of brain areas, most often using pared down stimuli and highly controlled behavioral paradigms. The historical emphasis on reductionism has placed most studies at one pole of an inherent trade-off between strictly controlled experimental variables and open designs that monitor the brain during its natural modes of operation. This bias toward simplified experiments has strongly shaped the field of visual neuroscience, with little guarantee that the principles and concepts established within that framework will apply more generally. In recent years, a growing number of studies have begun to relax strict experimental control with the aim of understanding how the brain responds under more naturalistic conditions. In this article, we survey research that has explicitly embraced the complexity and rhythm of natural vision. We focus on those studies most pertinent to understanding high-level visual specializations in brains of humans and nonhuman primates. We conclude that representationalist concepts borne from conventional visual experiments fall short in their ability to capture the real-life visual operations undertaken by the brain. More naturalistic approaches, though fraught with experimental and analytic challenges, provide fertile ground for neuroscientists seeking new inroads to investigate how the brain supports core aspects of our daily visual experience.

Primary visual cortex: awareness and blindsight.

The primary visual cortex (V1) is the principal telencephalic recipient of visual input in humans and monkeys. It is unique among cortical areas in that its destruction results in chronic blindness. However, certain patients with V1 damage, though lacking visual awareness, exhibit visually guided behavior: blindsight. This phenomenon, together with evidence from electrophysiological, neuroimaging, and psychophysical experiments, has led to speculation that V1 activity has a special or direct role in generating conscious perception. To explore this issue, this article reviews experiments that have used two powerful paradigms--stimulus-induced perceptual suppression and chronic V1 ablation--each of which disrupts the ability to perceive salient visual stimuli. Focus is placed on recent neurophysiological, behavioral, and functional imaging studies from the nonhuman primate that shed light on V1's role in conscious awareness. In addition, anatomical pathways that relay visual information to the cortex during normal vision and in blindsight are reviewed. Although the critical role of V1 in primate vision follows naturally from its position as a bottleneck of visual signals, little evidence supports its direct contribution to visual awareness.

Spiking Suppression Precedes Cued Attentional Enhancement of Neural Responses in Primary Visual Cortex.

Attending to a visual stimulus increases its detectability, even if gaze is directed elsewhere. This covert attentional selection is known to enhance spiking across many brain areas, including the primary visual cortex (V1). Here we investigate the temporal dynamics of attention-related spiking changes in V1 of macaques performing a task that separates attentional selection from the onset of visual stimulation. We found that preceding attentional enhancement there was a sharp, transient decline in spiking following presentation of an attention-guiding cue. This disruption of V1 spiking was not observed in a task-naïve subject that passively observed the same stimulus sequence, suggesting that sensory activation is insufficient to cause suppression. Following this suppression, attended stimuli evoked more spiking than unattended stimuli, matching previous reports of attention-related activity in V1. Laminar analyses revealed a distinct pattern of activation in feedback-associated layers during both the cue-induced suppression and subsequent attentional enhancement. These findings suggest that top-down modulation of V1 spiking can be bidirectional and result in either suppression or enhancement of spiking responses.

Tracking brain arousal fluctuations with fMRI.

Changes in brain activity accompanying shifts in vigilance and arousal can interfere with the study of other intrinsic and task-evoked characteristics of brain function. However, the difficulty of tracking and modeling the arousal state during functional MRI (fMRI) typically precludes the assessment of arousal-dependent influences on fMRI signals. Here we combine fMRI, electrophysiology, and the monitoring of eyelid behavior to demonstrate an approach for tracking continuous variations in arousal level from fMRI data. We first characterize the spatial distribution of fMRI signal fluctuations that track a measure of behavioral arousal; taking this pattern as a template, and using the local field potential as a simultaneous and independent measure of cortical activity, we observe that the time-varying expression level of this template in fMRI data provides a close approximation of electrophysiological arousal. We discuss the potential benefit of these findings for increasing the sensitivity of fMRI as a cognitive and clinical biomarker.

A population MRI brain template and analysis tools for the macaque.

The use of standard anatomical templates is common in human neuroimaging, as it facilitates data analysis and comparison across subjects and studies. For non-human primates, previous in vivo templates have lacked sufficient contrast to reliably validate known anatomical brain regions and have not provided tools for automated single-subject processing. Here we present the "National Institute of Mental Health Macaque Template", or NMT for short. The NMT is a high-resolution in vivo MRI template of the average macaque brain generated from 31 subjects, as well as a neuroimaging tool for improved data analysis and visualization. From the NMT volume, we generated maps of tissue segmentation and cortical thickness. Surface reconstructions and transformations to previously published digital brain atlases are also provided. We further provide an analysis pipeline using the NMT that automates and standardizes the time-consuming processes of brain extraction, tissue segmentation, and morphometric feature estimation for anatomical scans of individual subjects. The NMT and associated tools thus provide a common platform for precise single-subject data analysis and for characterizations of neuroimaging results across subjects and studies.

A digital 3D atlas of the marmoset brain based on multi-modal MRI.

The common marmoset (Callithrix jacchus) is a New-World monkey of growing interest in neuroscience. Magnetic resonance imaging (MRI) is an essential tool to unveil the anatomical and functional organization of the marmoset brain. To facilitate identification of regions of interest, it is desirable to register MR images to an atlas of the brain. However, currently available atlases of the marmoset brain are mainly based on 2D histological data, which are difficult to apply to 3D imaging techniques. Here, we constructed a 3D digital atlas based on high-resolution ex-vivo MRI images, including magnetization transfer ratio (a T1-like contrast), T2w images, and multi-shell diffusion MRI. Based on the multi-modal MRI images, we manually delineated 54 cortical areas and 16 subcortical regions on one hemisphere of the brain (the core version). The 54 cortical areas were merged into 13 larger cortical regions according to their locations to yield a coarse version of the atlas, and also parcellated into 106 sub-regions using a connectivity-based parcellation method to produce a refined atlas. Finally, we compared the new atlas set with existing histology atlases and demonstrated its applications in connectome studies, and in resting state and stimulus-based fMRI. The atlas set has been integrated into the widely-distributed neuroimaging data analysis software AFNI and SUMA, providing a readily usable multi-modal template space with multi-level anatomical labels (including labels from the Paxinos atlas) that can facilitate various neuroimaging studies of marmosets.

Ongoing Alpha Activity in V1 Regulates Visually Driven Spiking Responses.

The interlaminar connections in the primate primary visual cortex (V1) are well described, as is the presence of ongoing alpha-range (7-14 Hz) fluctuations in this area. Less well understood is how these interlaminar connections and ongoing fluctuations contribute to the regulation of visual spiking responses. Here, we investigate the relationship between alpha fluctuations and spiking responses to visual stimuli across cortical layers. Using laminar probes in macaque V1, we show that neural firing couples with the phase of alpha fluctuations, and that magnitude of this coupling is particularly pronounced during visual stimulation. The strongest modulation of spiking activity was observed in layers 2/3. Alpha-spike coupling and current source density analysis pointed to an infragranular origin of the alpha fluctuations. Taken together, these results indicate that ongoing infragranular alpha-range fluctuations in V1 play a role in regulating columnar visual activity.

Three-Dimensional Digital Template Atlas of the Macaque Brain.

We present a new 3D template atlas of the anatomical subdivisions of the macaque brain, which is based on and aligned to the magnetic resonance imaging (MRI) data set and histological sections of the Saleem and Logothetis atlas. We describe the creation and validation of the atlas that, when registered with macaque structural or functional MRI scans, provides a straightforward means to estimate the boundaries between architectonic areas, either in a 3D volume with different planes of sections, or on an inflated brain surface (cortical flat map). As such, this new template atlas is intended for use as a reference standard for macaque brain research. Atlases and templates are available as both volumes and surfaces in standard NIFTI and GIFTI formats.