An open-source MRI compatible frame for multimodal presurgical mapping in macaque and capuchin monkeys.

BACKGROUND: High-precision neurosurgical targeting in nonhuman primates (NHPs) often requires presurgical anatomical mapping with noninvasive neuroimaging techniques (MRI, CT, PET), allowing for translation of individual anatomical coordinates to surgical stereotaxic apparatus. Given the varied tissue contrasts that these imaging techniques produce, precise alignment of imaging-based coordinates to surgical apparatus can be cumbersome. MRI-compatible stereotaxis with radiopaque fiducial markers offer a straight-forward and reliable solution, but existing commercial options do not fit in conformal head coils that maximize imaging quality. NEW METHOD: We developed a compact MRI-compatible stereotaxis suitable for a variety of NHP species (Macaca mulatta, Macaca fascicularis, and Cebus apella) that allows multimodal alignment through technique-specific fiducial markers. COMPARISON WITH EXISTING METHODS: With the express purpose of compatibility with clinically available MRI, CT, and PET systems, the frame is no larger than a human head, while allowing for imaging NHPs in the supinated position. This design requires no marker implantation, special software, or additional knowledge other than the operation of a common large animal stereotaxis. RESULTS: We demonstrated the applicability of this 3D-printable apparatus across a diverse set of experiments requiring presurgical planning: 1) We demonstrate the accuracy of the fiducial system through a within-MRI cannula insertion and subcortical injection of a viral vector. 2) We also demonstrated accuracy of multimodal (MRI and CT) alignment and coordinate transfer to guide a surgical robot electrode implantation for deep-brain electrophysiology. CONCLUSIONS: The computer-aided design files and engineering drawings are publicly available, with the modular design allowing for low cost and manageable manufacturing.

Computational complexity drives sustained deliberation.

Economic deliberations are slow, effortful and intentional searches for solutions to difficult economic problems. Although such deliberations are critical for making sound decisions, the underlying reasoning strategies and neurobiological substrates remain poorly understood. Here two nonhuman primates performed a combinatorial optimization task to identify valuable subsets and satisfy predefined constraints. Their behavior revealed evidence of combinatorial reasoning-when low-complexity algorithms that consider items one at a time provided optimal solutions, the animals adopted low-complexity reasoning strategies. When greater computational resources were required, the animals approximated high-complexity algorithms that search for optimal combinations. The deliberation times reflected the demands created by computational complexity-high-complexity algorithms require more operations and, concomitantly, the animals deliberated for longer durations. Recurrent neural networks that mimicked low- and high-complexity algorithms also reflected the behavioral deliberation times and were used to reveal algorithm-specific computations that support economic deliberation. These findings reveal evidence for algorithm-based reasoning and establish a paradigm for studying the neurophysiological basis for sustained deliberation.

Quantitative single-cell transcriptome-based ranking of engineered AAVs in human retinal explants.

Gene therapy is a rapidly developing field, and adeno-associated viruses (AAVs) are a leading viral-vector candidate for therapeutic gene delivery. Newly engineered AAVs with improved abilities are now entering the clinic. It has proven challenging, however, to predict the translational potential of gene therapies developed in animal models due to cross-species differences. Human retinal explants are the only available model of fully developed human retinal tissue and are thus important for the validation of candidate AAV vectors. In this study, we evaluated 18 wild-type and engineered AAV capsids in human retinal explants using a recently developed single-cell RNA sequencing (RNA-seq) AAV engineering pipeline (scAAVengr). Human retinal explants retained the same major cell types as fresh retina, with similar expression of cell-specific markers except for a photoreceptor population with altered expression of photoreceptor-specific genes. The efficiency and tropism of AAVs in human explants were quantified with single-cell resolution. The top-performing serotypes, K91, K912, and 7m8, were further validated in non-human primate and human retinal explants. Together, this study provides detailed information about the transcriptome profiles of retinal explants and quantifies the infectivity of leading AAV serotypes in human retina, accelerating the translation of retinal gene therapies to the clinic.

Machine learning sequence prioritization for cell type-specific enhancer design.

Recent discoveries of extreme cellular diversity in the brain warrant rapid development of technologies to access specific cell populations within heterogeneous tissue. Available approaches for engineering-targeted technologies for new neuron subtypes are low yield, involving intensive transgenic strain or virus screening. Here, we present Specific Nuclear-Anchored Independent Labeling (SNAIL), an improved virus-based strategy for cell labeling and nuclear isolation from heterogeneous tissue. SNAIL works by leveraging machine learning and other computational approaches to identify DNA sequence features that confer cell type-specific gene activation and then make a probe that drives an affinity purification-compatible reporter gene. As a proof of concept, we designed and validated two novel SNAIL probes that target parvalbumin-expressing (PV+) neurons. Nuclear isolation using SNAIL in wild-type mice is sufficient to capture characteristic open chromatin features of PV+ neurons in the cortex, striatum, and external globus pallidus. The SNAIL framework also has high utility for multispecies cell probe engineering; expression from a mouse PV+ SNAIL enhancer sequence was enriched in PV+ neurons of the macaque cortex. Expansion of this technology has broad applications in cell type-specific observation, manipulation, and therapeutics across species and disease models.

Transcriptional and anatomical diversity of medium spiny neurons in the primate striatum.

Medium spiny neurons (MSNs) constitute the vast majority of striatal neurons and the principal interface between dopamine reward signals and functionally diverse cortico-basal ganglia circuits. Information processing in these circuits is dependent on distinct MSN types: cell types that are traditionally defined according to their projection targets or dopamine receptor expression. Single-cell transcriptional studies have revealed greater MSN heterogeneity than predicted by traditional circuit models, but the transcriptional landscape in the primate striatum remains unknown. Here, we set out to establish molecular definitions for MSN subtypes in Rhesus monkeys and to explore the relationships between transcriptionally defined subtypes and anatomical subdivisions of the striatum. Our results suggest at least nine MSN subtypes, including dorsal striatum subtypes associated with striosome and matrix compartments, ventral striatum subtypes associated with the nucleus accumbens shell and olfactory tubercle, and an MSN-like cell type restricted to µ-opioid receptor rich islands in the ventral striatum. Although each subtype was demarcated by discontinuities in gene expression, continuous variation within subtypes defined gradients corresponding to anatomical locations and, potentially, functional specializations. These results lay the foundation for achieving cell-type-specific transgenesis in the primate striatum and provide a blueprint for investigating circuit-specific information processing.

scAAVengr, a transcriptome-based pipeline for quantitative ranking of engineered AAVs with single-cell resolution.

Background: Adeno-associated virus (AAV)-mediated gene therapies are rapidly advancing to the clinic, and AAV engineering has resulted in vectors with increased ability to deliver therapeutic genes. Although the choice of vector is critical, quantitative comparison of AAVs, especially in large animals, remains challenging. Methods: Here, we developed an efficient single-cell AAV engineering pipeline (scAAVengr) to simultaneously quantify and rank efficiency of competing AAV vectors across all cell types in the same animal. Results: To demonstrate proof-of-concept for the scAAVengr workflow, we quantified - with cell-type resolution - the abilities of naturally occurring and newly engineered AAVs to mediate gene expression in primate retina following intravitreal injection. A top performing variant identified using this pipeline, K912, was used to deliver SaCas9 and edit the rhodopsin gene in macaque retina, resulting in editing efficiency similar to infection rates detected by the scAAVengr workflow. scAAVengr was then used to identify top-performing AAV variants in mouse brain, heart, and liver following systemic injection. Conclusions: These results validate scAAVengr as a powerful method for development of AAV vectors. Funding: This work was supported by funding from the Ford Foundation, NEI/NIH, Research to Prevent Blindness, Foundation Fighting Blindness, UPMC Immune Transplant and Therapy Center, and the Van Sloun fund for canine genetic research.

Gene therapy is an experimental approach to treating disease that involves altering faulty genes or replacing them with new, working copies. Most often, the new genetic material is delivered into cells using a modified virus that no longer causes disease, called a viral vector. Virus-mediated gene therapies are currently being explored for degenerative eye diseases, such as retinitis pigmentosa, and neurological disorders, like Alzheimer's and Parkinson's disease. A number of gene therapies have also been approved for treating some rare cancers, blood disorders and a childhood form of motor neuron disease. Despite the promise of virus-mediated gene therapy, there are significant hurdles to its widespread success. Viral vectors need to deliver enough genetic material to the right cells without triggering an immune response or causing serious side effects. Selecting an optimal vector is key to achieving this. A type of viruses called adeno-associated viruses (AAV) are prime candidates, partly because they can be easily engineered. However, accurately comparing the safety and efficacy of newly engineered AAVs is difficult, due to variation between test subjects and the labor and cost involved in careful testing. Öztürk et al. addressed this issue by developing an experimental pipeline called scAAVengr for comparing gene therapy vectors head-to-head. The process involves tagging potential AAV vectors with unique genetic barcodes, which can then be detected and quantified in individual cells using a technique called single-cell RNA sequencing. This means that when several vectors are used to infect lab-grown cells or a test animal at the same time, they can be tracked. The vectors can then be ranked on their ability to infect specific cell types and deliver useful genetic material. Using scAAVengr, Öztürk et al. compared viral vectors designed to target the light-sensitive cells of the retina, which allow animals to see. First, a set of promising viral vectors were evaluated using the scAAVengr pipeline in the eyes of marmosets and macaques, two small primates. Precise levels and locations of gene delivery were quantified. The top-performing vector was then identified and used to deliver Cas9, a genome editing tool, to primate retinas. Öztürk et al. also used scAAVengr to compare viral vectors in mice, analysing the vectors' ability to deliver their genetic cargo to the brain, heart, and liver. These experiments demonstrated that scAAVengr can be used to evaluate vectors in multiple tissues and in different organisms. In summary, this work outlines a method for identifying and precisely quantifying the performance of top-performing viral vectors for gene therapy. By aiding the selection of optimal viral vectors, the scAAVengr pipeline could help to improve the success of preclinical studies and early clinical trials testing gene therapies.

Rare rewards amplify dopamine responses.

Dopamine prediction error responses are essential components of universal learning mechanisms. However, it is unknown whether individual dopamine neurons reflect the shape of reward distributions. Here, we used symmetrical distributions with differently weighted tails to investigate how the frequency of rewards and reward prediction errors influence dopamine signals. Rare rewards amplified dopamine responses, even when conventional prediction errors were identical, indicating a mechanism for learning the complexities of real-world incentives.

Dopamine Signals Learn New Tricks.

In this issue of Neuron, Morrens et al. (2020) show that stimulus-evoked dopamine responses are enhanced by novelty and increase the rate at which animals acquire conditioned responses. These results provide a candidate neural mechanism for latent inhibition and illustrate a new role of dopamine signals in learning.

Reward and value coding by dopamine neurons in non-human primates.

Rewards are fundamental to everyday life. They confer pleasure, support learning, and mediate decisions. Dopamine-releasing neurons in the midbrain are critical for reward processing. These neurons receive input from more than 30 brain areas and send widespread projections to the basal ganglia and frontal cortex. Their phasic responses are tuned to rewards. Specifically, dopamine signals code reward prediction error, the difference between received and predicted rewards. Decades of research in awake, behaving non-human primates (NHP), have shown the importance of these neural signals for learning and decision making. In this review, we will provide an overview of the bedrock findings that support the reward prediction error hypothesis and examine evidence that this signal plays a role in learning and decision making. In addition, we will highlight some of the conceptual challenges in dopamine neurophysiology and identify future areas of research to address these challenges. Keeping with the theme of this special issue, we will focus on the role of NHP studies in understanding dopamine neurophysiology and make the argument that primate models are essential to this line of research.

Nonhuman Primate Optogenetics: Recent Advances and Future Directions.

Optogenetics is the use of genetically coded, light-gated ion channels or pumps (opsins) for millisecond resolution control of neural activity. By targeting opsin expression to specific cell types and neuronal pathways, optogenetics can expand our understanding of the neural basis of normal and pathological behavior. To maximize the potential of optogenetics to study human cognition and behavior, optogenetics should be applied to the study of nonhuman primates (NHPs). The homology between NHPs and humans makes these animals the best experimental model for understanding human brain function and dysfunction. Moreover, for genetic tools to have translational promise, their use must be demonstrated effectively in large, wild-type animals such as Rhesus macaques. Here, we review recent advances in primate optogenetics. We highlight the technical hurdles that have been cleared, challenges that remain, and summarize how optogenetic experiments are expanding our understanding of primate brain function.

Dopamine neurons learn relative chosen value from probabilistic rewards.

Economic theories posit reward probability as one of the factors defining reward value. Individuals learn the value of cues that predict probabilistic rewards from experienced reward frequencies. Building on the notion that responses of dopamine neurons increase with reward probability and expected value, we asked how dopamine neurons in monkeys acquire this value signal that may represent an economic decision variable. We found in a Pavlovian learning task that reward probability-dependent value signals arose from experienced reward frequencies. We then assessed neuronal response acquisition during choices among probabilistic rewards. Here, dopamine responses became sensitive to the value of both chosen and unchosen options. Both experiments showed also the novelty responses of dopamine neurones that decreased as learning advanced. These results show that dopamine neurons acquire predictive value signals from the frequency of experienced rewards. This flexible and fast signal reflects a specific decision variable and could update neuronal decision mechanisms.

Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques.

Optogenetic studies in mice have revealed new relationships between well-defined neurons and brain functions. However, there are currently no means to achieve the same cell-type specificity in monkeys, which possess an expanded behavioral repertoire and closer anatomical homology to humans. Here, we present a resource for cell-type-specific channelrhodopsin expression in Rhesus monkeys and apply this technique to modulate dopamine activity and monkey choice behavior. These data show that two viral vectors label dopamine neurons with greater than 95% specificity. Infected neurons were activated by light pulses, indicating functional expression. The addition of optical stimulation to reward outcomes promoted the learning of reward-predicting stimuli at the neuronal and behavioral level. Together, these results demonstrate the feasibility of effective and selective stimulation of dopamine neurons in non-human primates and a resource that could be applied to other cell types in the monkey brain.

Utility functions predict variance and skewness risk preferences in monkeys.

Utility is the fundamental variable thought to underlie economic choices. In particular, utility functions are believed to reflect preferences toward risk, a key decision variable in many real-life situations. To assess the validity of utility representations, it is therefore important to examine risk preferences. In turn, this approach requires formal definitions of risk. A standard approach is to focus on the variance of reward distributions (variance-risk). In this study, we also examined a form of risk related to the skewness of reward distributions (skewness-risk). Thus, we tested the extent to which empirically derived utility functions predicted preferences for variance-risk and skewness-risk in macaques. The expected utilities calculated for various symmetrical and skewed gambles served to define formally the direction of stochastic dominance between gambles. In direct choices, the animals' preferences followed both second-order (variance) and third-order (skewness) stochastic dominance. Specifically, for gambles with different variance but identical expected values (EVs), the monkeys preferred high-variance gambles at low EVs and low-variance gambles at high EVs; in gambles with different skewness but identical EVs and variances, the animals preferred positively over symmetrical and negatively skewed gambles in a strongly transitive fashion. Thus, the utility functions predicted the animals' preferences for variance-risk and skewness-risk. Using these well-defined forms of risk, this study shows that monkeys' choices conform to the internal reward valuations suggested by their utility functions. This result implies a representation of utility in monkeys that accounts for both variance-risk and skewness-risk preferences.

Components and characteristics of the dopamine reward utility signal.

Rewards are defined by their behavioral functions in learning (positive reinforcement), approach behavior, economic choices, and emotions. Dopamine neurons respond to rewards with two components, similar to higher order sensory and cognitive neurons. The initial, rapid, unselective dopamine detection component reports all salient environmental events irrespective of their reward association. It is highly sensitive to factors related to reward and thus detects a maximal number of potential rewards. It also senses aversive stimuli but reports their physical impact rather than their aversiveness. The second response component processes reward value accurately and starts early enough to prevent confusion with unrewarded stimuli and objects. It codes reward value as a numeric, quantitative utility prediction error, consistent with formal concepts of economic decision theory. Thus, the dopamine reward signal is fast, highly sensitive and appropriate for driving and updating economic decisions.

Systems Neuroscience: Shaping the Reward Prediction Error Signal.

A recent study shows that midbrain GABA (inhibitory) neurons code for environmentally predicted rewards. These GABA neurons communicate with dopamine neurons, where the reward prediction is subtracted from delivered reward. Thus, the GABA prediction signal shapes the dopamine reward prediction error signal.

Economic choices reveal probability distortion in macaque monkeys.

Economic choices are largely determined by two principal elements, reward value (utility) and probability. Although nonlinear utility functions have been acknowledged for centuries, nonlinear probability weighting (probability distortion) was only recently recognized as a ubiquitous aspect of real-world choice behavior. Even when outcome probabilities are known and acknowledged, human decision makers often overweight low probability outcomes and underweight high probability outcomes. Whereas recent studies measured utility functions and their corresponding neural correlates in monkeys, it is not known whether monkeys distort probability in a manner similar to humans. Therefore, we investigated economic choices in macaque monkeys for evidence of probability distortion. We trained two monkeys to predict reward from probabilistic gambles with constant outcome values (0.5 ml or nothing). The probability of winning was conveyed using explicit visual cues (sector stimuli). Choices between the gambles revealed that the monkeys used the explicit probability information to make meaningful decisions. Using these cues, we measured probability distortion from choices between the gambles and safe rewards. Parametric modeling of the choices revealed classic probability weighting functions with inverted-S shape. Therefore, the animals overweighted low probability rewards and underweighted high probability rewards. Empirical investigation of the behavior verified that the choices were best explained by a combination of nonlinear value and nonlinear probability distortion. Together, these results suggest that probability distortion may reflect evolutionarily preserved neuronal processing.

Dopamine reward prediction error responses reflect marginal utility.

BACKGROUND: Optimal choices require an accurate neuronal representation of economic value. In economics, utility functions are mathematical representations of subjective value that can be constructed from choices under risk. Utility usually exhibits a nonlinear relationship to physical reward value that corresponds to risk attitudes and reflects the increasing or decreasing marginal utility obtained with each additional unit of reward. Accordingly, neuronal reward responses coding utility should robustly reflect this nonlinearity. RESULTS: In two monkeys, we measured utility as a function of physical reward value from meaningful choices under risk (that adhered to first- and second-order stochastic dominance). The resulting nonlinear utility functions predicted the certainty equivalents for new gambles, indicating that the functions' shapes were meaningful. The monkeys were risk seeking (convex utility function) for low reward and risk avoiding (concave utility function) with higher amounts. Critically, the dopamine prediction error responses at the time of reward itself reflected the nonlinear utility functions measured at the time of choices. In particular, the reward response magnitude depended on the first derivative of the utility function and thus reflected the marginal utility. Furthermore, dopamine responses recorded outside of the task reflected the marginal utility of unpredicted reward. Accordingly, these responses were sufficient to train reinforcement learning models to predict the behaviorally defined expected utility of gambles. CONCLUSIONS: These data suggest a neuronal manifestation of marginal utility in dopamine neurons and indicate a common neuronal basis for fundamental explanatory constructs in animal learning theory (prediction error) and economic decision theory (marginal utility).