Neural representational geometries reflect behavioral differences in monkeys and recurrent neural networks.

Animals likely use a variety of strategies to solve laboratory tasks. Traditionally, combined analysis of behavioral and neural recording data across subjects employing different strategies may obscure important signals and give confusing results. Hence, it is essential to develop techniques that can infer strategy at the single-subject level. We analyzed an experiment in which two male monkeys performed a visually cued rule-based task. The analysis of their performance shows no indication that they used a different strategy. However, when we examined the geometry of stimulus representations in the state space of the neural activities recorded in dorsolateral prefrontal cortex, we found striking differences between the two monkeys. Our purely neural results induced us to reanalyze the behavior. The new analysis showed that the differences in representational geometry are associated with differences in the reaction times, revealing behavioral differences we were unaware of. All these analyses suggest that the monkeys are using different strategies. Finally, using recurrent neural network models trained to perform the same task, we show that these strategies correlate with the amount of training, suggesting a possible explanation for the observed neural and behavioral differences.

Revealing unexpected complex encoding but simple decoding mechanisms in motor cortex via separating behaviorally relevant neural signals.

In motor cortex, behaviorally relevant neural responses are entangled with irrelevant signals, which complicates the study of encoding and decoding mechanisms. It remains unclear whether behaviorally irrelevant signals could conceal some critical truth. One solution is to accurately separate behaviorally relevant and irrelevant signals at both single-neuron and single-trial levels, but this approach remains elusive due to the unknown ground truth of behaviorally relevant signals. Therefore, we propose a framework to define, extract, and validate behaviorally relevant signals. Analyzing separated signals in three monkeys performing different reaching tasks, we found neural responses previously considered to contain little information actually encode rich behavioral information in complex nonlinear ways. These responses are critical for neuronal redundancy and reveal movement behaviors occupy a higher-dimensional neural space than previously expected. Surprisingly, when incorporating often-ignored neural dimensions, behaviorally relevant signals can be decoded linearly with comparable performance to nonlinear decoding, suggesting linear readout may be performed in motor cortex. Our findings prompt that separating behaviorally relevant signals may help uncover more hidden cortical mechanisms.

Comparative basolateral amygdala connectomics reveals dissociable single-neuron projection patterns to frontal cortex in macaques and mice.

Basolateral amygdala (BLA) is a key hub for affect in the brain,1,2,3 and dysfunction within this area contributes to a host of psychiatric disorders.4,5 BLA is extensively and reciprocally interconnected with frontal cortex,6,7,8,9 and some aspects of its function are evolutionarily conserved across rodents, anthropoid primates, and humans.10 Neuron density in BLA is substantially lower in primates compared to murine rodents,11 and frontal cortex (FC) is dramatically expanded in primates, particularly the more anterior granular and dysgranular areas.12,13,14 Yet, how these anatomical differences influence the projection patterns of single BLA neurons to frontal cortex across rodents and primates is unknown. Using a barcoded connectomic approach, we assessed the single BLA neuron connections to frontal cortex in mice and macaques. We found that BLA neurons are more likely to project to multiple distinct parts of FC in mice than in macaques. Further, while single BLA neuron projections to nucleus accumbens were similarly organized in mice and macaques, BLA-FC connections differed substantially. Notably, BLA connections to subcallosal anterior cingulate cortex (scACC) in macaques were least likely to branch to other medial frontal cortex areas compared to perigenual ACC (pgACC). This pattern of connections was reversed in the mouse homologues of these areas, infralimbic and prelimbic cortex (IL and PL), mirroring functional differences between rodents and non-human primates. Taken together, these results indicate that BLA connections to FC are not linearly scaled from mice to macaques and instead the organization of single-neuron BLA connections is distinct between these species.

Facial expressivity in dominant macaques is linked to group cohesion.

Social living affords primates (including humans) many benefits. Communication has been proposed to be the key mechanism used to bond social connections, which could explain why primates have evolved such expressive faces. We assessed whether the facial expressivity of the dominant male (quantified from the coding of anatomically based facial movement) was related to social network properties (based on social proximity and grooming) in nine groups of captive rhesus macaques (Macaca mulatta) housed in uniform physical and social environments. More facially expressive dominant male macaques were more socially connected and had more cohesive social groups. These findings show that inter-individual differences in facial expressivity are related to differential social outcomes at both an individual and group level. More expressive individuals occupy more beneficial social positions, which could help explain the selection for complex facial communication in primates.

Factorized visual representations in the primate visual system and deep neural networks.

Object classification has been proposed as a principal objective of the primate ventral visual stream and has been used as an optimization target for deep neural network models (DNNs) of the visual system. However, visual brain areas represent many different types of information, and optimizing for classification of object identity alone does not constrain how other information may be encoded in visual representations. Information about different scene parameters may be discarded altogether ('invariance'), represented in non-interfering subspaces of population activity ('factorization') or encoded in an entangled fashion. In this work, we provide evidence that factorization is a normative principle of biological visual representations. In the monkey ventral visual hierarchy, we found that factorization of object pose and background information from object identity increased in higher-level regions and strongly contributed to improving object identity decoding performance. We then conducted a large-scale analysis of factorization of individual scene parameters - lighting, background, camera viewpoint, and object pose - in a diverse library of DNN models of the visual system. Models which best matched neural, fMRI, and behavioral data from both monkeys and humans across 12 datasets tended to be those which factorized scene parameters most strongly. Notably, invariance to these parameters was not as consistently associated with matches to neural and behavioral data, suggesting that maintaining non-class information in factorized activity subspaces is often preferred to dropping it altogether. Thus, we propose that factorization of visual scene information is a widely used strategy in brains and DNN models thereof.

When looking at a picture, we can quickly identify a recognizable object, such as an apple, applying a single word label to it. Although extensive neuroscience research has focused on how human and monkey brains achieve this recognition, our understanding of how the brain and brain-like computer models interpret other complex aspects of a visual scene ­ such as object position and environmental context ­ remains incomplete. In particular, it was not clear to what extent object recognition comes at the expense of other important scene details. For example, various aspects of the scene might be processed simultaneously. On the other hand, general object recognition may interfere with processing of such details. To investigate this, Lindsey and Issa analyzed 12 monkey and human brain datasets, as well as numerous computer models, to explore how different aspects of a scene are encoded in neurons and how these aspects are represented by computational models. The analysis revealed that preventing effective separation and retention of information about object pose and environmental context worsened object identification in monkey cortex neurons. In addition, the computer models that were the most brain-like could independently preserve the other scene details without interfering with object identification. The findings suggest that human and monkey high level ventral visual processing systems are capable of representing the environment in a more complex way than previously appreciated. In the future, studying more brain activity data could help to identify how rich the encoded information is and how it might support other functions like spatial navigation. This knowledge could help to build computational models that process the information in the same way, potentially improving their understanding of real-world scenes.

Outdoor noncontact respiratory measurements of unrestricted rhesus macaques (Macaca mulatta) using millimeter-wave radar.

Respiration is an invaluable signal that facilitates the real-time observation of physiological dynamics. In recent years, the advancement of noncontact measurement technology has gained momentum in capturing physiological activities in natural settings. This technology is anticipated to be found not only in humans but also in nonhuman primates. Currently, the predominant noncontact approach for nonhuman animals involves measuring vital signs through subtle variations in skin color. However, this approach is limited when addressing areas of the body covered with hair or when working in outdoor settings under fluctuating sunlight. To overcome this issue, we focused on noncontact respiratory measurements using millimeter-wave radar. Millimeter-wave radar systems, which employ millimeter waves that can penetrate animal fur and estimate respiration-derived periodic body motion, exhibit minimal susceptibility to sunlight interference. Thus, this method shows potential for conducting noncontact vital measurements in natural and outdoor settings. In this study, we validated a millimeter-wave radar methodology for capturing respiration in outdoor-housed rhesus macaques (Macaca mulatta). The radar was positioned beyond the captive enclosure and maintained at a distance >5 m from the target. Millimeter waves were transmitted to the target, and the reflected waves were used to estimate skin surface displacement associated with respiration. The results revealed periodic skin surface displacement, and the estimated respiratory rates weres within the reported range of respiratory rates for rhesus macaques. These results suggest the potential applicability of millimeter-wave radar for noncontact respiration monitoring in outdoor-living macaques without anesthesia or immobilization. The continued advancement of noncontact vital measurement technology will contribute to understanding primate mental and physical dynamics during their daily life.

Mental navigation in the primate entorhinal cortex.

A cognitive map is a suitably structured representation that enables novel computations using previous experience; for example, planning a new route in a familiar space1. Work in mammals has found direct evidence for such representations in the presence of exogenous sensory inputs in both spatial2,3 and non-spatial domains4-10. Here we tested a foundational postulate of the original cognitive map theory1,11: that cognitive maps support endogenous computations without external input. We recorded from the entorhinal cortex of monkeys in a mental navigation task that required the monkeys to use a joystick to produce one-dimensional vectors between pairs of visual landmarks without seeing the intermediate landmarks. The ability of the monkeys to perform the task and generalize to new pairs indicated that they relied on a structured representation of the landmarks. Task-modulated neurons exhibited periodicity and ramping that matched the temporal structure of the landmarks and showed signatures of continuous attractor networks12,13. A continuous attractor network model of path integration14 augmented with a Hebbian-like learning mechanism provided an explanation of how the system could endogenously recall landmarks. The model also made an unexpected prediction that endogenous landmarks transiently slow path integration, reset the dynamics and thereby reduce variability. This prediction was borne out in a reanalysis of firing rate variability and behaviour. Our findings link the structured patterns of activity in the entorhinal cortex to the endogenous recruitment of a cognitive map during mental navigation.

Determinants of macaques' space use: A test for the ecological constraints model using GPS collars.

As a central topic in Behavioral Ecology, animal space use involves dynamic responses to social and ecological factors. We collared 22 rhesus macaques (Macaca mulatta) from six groups on Neilingding Island, China, and collected 80,625 hourly fixes over a year. Using this high-resolution location data set, we quantified the macaques' space use at the individual level and tested the ecological constraints model while considering various environmental and human interfering factors. As predicted by the ecological constraints model, macaques in larger groups had longer daily path lengths (DPLs) and larger home ranges. We found an inverted U-shape relationship between mean daily temperatures and DPLs, indicating that macaques traveled farther on mild temperature days, while they decreased DPLs when temperatures were too high or too low. Anthropogenic food subsidies were positively correlated to DPLs, while the effect of rainfall was negative. Macaques decreased their DPLs and core areas when more flowers and less leaves were available, suggesting that macaques shifted their space use patterns to adapt to the seasonal differences in food resources. By applying GPS collars on a large number of individuals living on a small island, we gained valuable insights into within-group exploitation competition in wild rhesus macaques.

Ecological disturbance alters the adaptive benefits of social ties.

Extreme weather events radically alter ecosystems. When ecological damage persists, selective pressures on individuals can change, leading to phenotypic adjustments. For group-living animals, social relationships may be a mechanism enabling adaptation to ecosystem disturbance. Yet whether such events alter selection on sociality and whether group-living animals can, as a result, adaptively change their social relationships remain untested. We leveraged 10 years of data collected on rhesus macaques before and after a category 4 hurricane caused persistent deforestation, exacerbating monkeys' exposure to intense heat. In response, macaques demonstrated persistently increased tolerance and decreased aggression toward other monkeys, facilitating access to scarce shade critical for thermoregulation. Social tolerance predicted individual survival after the hurricane, but not before it, revealing a shift in the adaptive function of sociality.

Low and high beta rhythms have different motor cortical sources and distinct roles in movement control and spatiotemporal attention.

Low and high beta frequency rhythms were observed in the motor cortex, but their respective sources and behavioral correlates remain unknown. We studied local field potentials (LFPs) during pre-cued reaching behavior in macaques. They contained a low beta band (<20 Hz) dominant in primary motor cortex and a high beta band (>20 Hz) dominant in dorsal premotor cortex (PMd). Low beta correlated positively with reaction time (RT) from visual cue onset and negatively with uninstructed hand postural micro-movements throughout the trial. High beta reflected temporal task prediction, with selective modulations before and during cues, which were enhanced in moments of increased focal attention when the gaze was on the work area. This double-dissociation in sources and behavioral correlates of motor cortical low and high beta, with respect to both task-instructed and spontaneous behavior, reconciles the largely disparate roles proposed for the beta rhythm, by suggesting band-specific roles in both movement control and spatiotemporal attention.

The neural representation of an auditory spatial cue in the primate cortex.

Humans make use of small differences in the timing of sounds at the two ears-interaural time differences (ITDs)-to locate their sources. Despite extensive investigation, however, the neural representation of ITDs in the human brain is contentious, particularly the range of ITDs explicitly represented by dedicated neural detectors. Here, using magneto- and electro-encephalography (MEG and EEG), we demonstrate evidence of a sparse neural representation of ITDs in the human cortex. The magnitude of cortical activity to sounds presented via insert earphones oscillated as a function of increasing ITD-within and beyond auditory cortical regions-and listeners rated the perceptual quality of these sounds according to the same oscillating pattern. This pattern was accurately described by a population of model neurons with preferred ITDs constrained to the narrow, sound-frequency-dependent range evident in other mammalian species. When scaled for head size, the distribution of ITD detectors in the human cortex is remarkably like that recorded in vivo from the cortex of rhesus monkeys, another large primate that uses ITDs for source localization. The data solve a long-standing issue concerning the neural representation of ITDs in humans and suggest a representation that scales for head size and sound frequency in an optimal manner.

Simple visual stimuli are sufficient to drive responses in action observation and execution neurons in macaque ventral premotor cortex.

Neurons responding during action execution and action observation were discovered in the ventral premotor cortex 3 decades ago. However, the visual features that drive the responses of action observation/execution neurons (AOENs) have not been revealed at present. We investigated the neural responses of AOENs in ventral premotor area F5c of 4 macaques during the observation of action videos and crucial control stimuli. The large majority of AOENs showed highly phasic responses during the action videos, with a preference for the moment that the hand made contact with the object. They also responded to an abstract shape moving towards but not interacting with an object, even when the shape moved on a scrambled background, implying that most AOENs in F5c do not require the perception of causality or a meaningful action. Additionally, the majority of AOENs responded to static frames of the videos. Our findings show that very elementary stimuli, even without a grasping context, are sufficient to drive responses in F5c AOENs.

Temporal multiplexing of perception and memory codes in IT cortex.

A central assumption of neuroscience is that long-term memories are represented by the same brain areas that encode sensory stimuli1. Neurons in inferotemporal (IT) cortex represent the sensory percept of visual objects using a distributed axis code2-4. Whether and how the same IT neural population represents the long-term memory of visual objects remains unclear. Here we examined how familiar faces are encoded in the IT anterior medial face patch (AM), perirhinal face patch (PR) and temporal pole face patch (TP). In AM and PR we observed that the encoding axis for familiar faces is rotated relative to that for unfamiliar faces at long latency; in TP this memory-related rotation was much weaker. Contrary to previous claims, the relative response magnitude to familiar versus unfamiliar faces was not a stable indicator of familiarity in any patch5-11. The mechanism underlying the memory-related axis change is likely intrinsic to IT cortex, because inactivation of PR did not affect axis change dynamics in AM. Overall, our results suggest that memories of familiar faces are represented in AM and perirhinal cortex by a distinct long-latency code, explaining how the same cell population can encode both the percept and memory of faces.

Cingulate microstimulation induces negative decision-making via reduced top-down influence on primate fronto-cingulo-striatal network.

The dorsolateral prefrontal cortex (dlPFC) is crucial for regulation of emotion that is known to aid prevention of depression. The broader fronto-cingulo-striatal (FCS) network, including cognitive dlPFC and limbic cingulo-striatal regions, has been associated with a negative evaluation bias often seen in depression. The mechanism by which dlPFC regulates the limbic system remains largely unclear. Here we have successfully induced a negative bias in decision-making in female primates performing a conflict decision-making task, by directly microstimulating the subgenual cingulate cortex while simultaneously recording FCS local field potentials (LFPs). The artificially induced negative bias in decision-making was associated with a significant decrease in functional connectivity from cognitive to limbic FCS regions, represented by a reduction in Granger causality in beta-range LFPs from the dlPFC to the other regions. The loss of top-down directional influence from cognitive to limbic regions, we suggest, could underlie negative biases in decision-making as observed in depressive states.

Neural populations within macaque early vestibular pathways are adapted to encode natural self-motion.

How the activities of large neural populations are integrated in the brain to ensure accurate perception and behavior remains a central problem in systems neuroscience. Here, we investigated population coding of naturalistic self-motion by neurons within early vestibular pathways in rhesus macaques (Macacca mulatta). While vestibular neurons displayed similar dynamic tuning to self-motion, inspection of their spike trains revealed significant heterogeneity. Further analysis revealed that, during natural but not artificial stimulation, heterogeneity resulted primarily from variability across neurons as opposed to trial-to-trial variability. Interestingly, vestibular neurons displayed different correlation structures during naturalistic and artificial self-motion. Specifically, while correlations due to the stimulus (i.e., signal correlations) did not differ, correlations between the trial-to-trial variabilities of neural responses (i.e., noise correlations) were instead significantly positive during naturalistic but not artificial stimulation. Using computational modeling, we show that positive noise correlations during naturalistic stimulation benefits information transmission by heterogeneous vestibular neural populations. Taken together, our results provide evidence that neurons within early vestibular pathways are adapted to the statistics of natural self-motion stimuli at the population level. We suggest that similar adaptations will be found in other systems and species.

Perceptography unveils the causal contribution of inferior temporal cortex to visual perception.

Neurons in the inferotemporal (IT) cortex respond selectively to complex visual features, implying their role in object perception. However, perception is subjective and cannot be read out from neural responses; thus, bridging the causal gap between neural activity and perception demands independent characterization of perception. Historically, though, the complexity of the perceptual alterations induced by artificial stimulation of IT cortex has rendered them impossible to quantify. To address this old problem, we tasked male macaque monkeys to detect and report optical impulses delivered to their IT cortex. Combining machine learning with high-throughput behavioral optogenetics, we generated complex and highly specific images that were hard for the animal to distinguish from the state of being cortically stimulated. These images, named "perceptograms" for the first time, reveal and depict the contents of the complex hallucinatory percepts induced by local neural perturbation in IT cortex. Furthermore, we found that the nature and magnitude of these hallucinations highly depend on concurrent visual input, stimulation location, and intensity. Objective characterization of stimulation-induced perceptual events opens the door to developing a mechanistic theory of visual perception. Further, it enables us to make better visual prosthetic devices and gain a greater understanding of visual hallucinations in mental disorders.

Neural signatures of natural behaviour in socializing macaques.

Our understanding of the neurobiology of primate behaviour largely derives from artificial tasks in highly controlled laboratory settings, overlooking most natural behaviours that primate brains evolved to produce1-3. How primates navigate the multidimensional social relationships that structure daily life4 and shape survival and reproductive success5 remains largely unclear at the single-neuron level. Here we combine ethological analysis, computer vision and wireless recording technologies to identify neural signatures of natural behaviour in unrestrained, socially interacting pairs of rhesus macaques. Single-neuron and population activity in the prefrontal and temporal cortex robustly encoded 24 species-typical behaviours, as well as social context. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioural mechanism supporting friendships and alliances6, and neural activity maintained a running account of these social investments. Confronted with an aggressive intruder, behavioural and neural population responses reflected empathy and were buffered by the presence of a partner. Our findings reveal a highly distributed neurophysiological ledger of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

An analysis of risk factors for spontaneously occurring type 2 diabetes mellitus in rhesus macaques (Macaca mulatta).

BACKGROUND: Type 2 Diabetes Mellitus (T2D) is a chronic disease with a high prevalence worldwide. Human literature suggests factors beyond well-known risk factors (e.g., age, body mass index) for T2D: cytomegalovirus serostatus, season of birth, maternal age, birth weight, and depression. Nothing is known, however, about whether these variables are influential in primate models of T2D. METHODS: Using a retrospective methodology, we identified 22 cases of spontaneously occurring T2D among rhesus monkeys at our facility. A control sample of n = 1199 was identified. RESULTS: Animals born to mothers that were ≤5.5 years of age, and animals that showed heightened Activity and Emotionality in response to brief separation in infancy, had a greater risk for development of T2D in adulthood. CONCLUSIONS: Knowledge of additional risk factors for T2D could help colony managers better identify at-risk animals and enable diabetes researchers to select animals that might be more responsive to their manipulations.

Repeatability of measures of behavioral organization over two years in captive infant rhesus macaques, Macaca mulatta.

Individual differences of infant temperament have been associated with future health outcomes that provide explanatory power beyond adult personality. Despite the importance of such a metric, our developmental understanding of personality-like traits is poor. Therefore, we examined whether young primates show consistency in personality traits throughout development. We replicated a Biobehavioral Assessment (BBA) at three time periods: 3-4 months, 1 year, and 2 years of age in 47 rhesus macaque (Macaca mulatta) subjects from large mixed-sex outdoor social housing units at the California National Primate Research Center. We report results for tests focused on responses and adaptation to the temporary separation and relocation, responses to a threatening stimulus, and ratings of overall temperament. We found consistently repeatable associations in measures of Emotionality; these associations were stronger in males, but also present in females, and broadly consistent between Years 1 and 2. We also explored whether behavioral responses to this experimental relocation might be influenced by their experience being relocated for other reasons (i.e., hospitalizations) as individuals' responses might be influenced by similar experiences to the BBA procedure. Only locomotion, during one of the assessments, was associated with past hospitalization events. Overall, repeatability in Emotionality-associated behaviors was evident across the 2 years, in both sexes. We did, however, find evidence of the emergence of sex differences via differentiated expression of behavioral responses during the BBA. We emphasize that there is likely contextual nuance in the use of these BBA factor-associated behaviors. Further research is required to determine whether and how shifts occur in underlying factor structure and the expression of associated behaviors.