Residual dynamics resolves recurrent contributions to neural computation.

Relating neural activity to behavior requires an understanding of how neural computations arise from the coordinated dynamics of distributed, recurrently connected neural populations. However, inferring the nature of recurrent dynamics from partial recordings of a neural circuit presents considerable challenges. Here we show that some of these challenges can be overcome by a fine-grained analysis of the dynamics of neural residuals-that is, trial-by-trial variability around the mean neural population trajectory for a given task condition. Residual dynamics in macaque prefrontal cortex (PFC) in a saccade-based perceptual decision-making task reveals recurrent dynamics that is time dependent, but consistently stable, and suggests that pronounced rotational structure in PFC trajectories during saccades is driven by inputs from upstream areas. The properties of residual dynamics restrict the possible contributions of PFC to decision-making and saccade generation and suggest a path toward fully characterizing distributed neural computations with large-scale neural recordings and targeted causal perturbations.

Learning shapes cortical dynamics to enhance integration of relevant sensory input.

Adaptive sensory behavior is thought to depend on processing in recurrent cortical circuits, but how dynamics in these circuits shapes the integration and transmission of sensory information is not well understood. Here, we study neural coding in recurrently connected networks of neurons driven by sensory input. We show analytically how information available in the network output varies with the alignment between feedforward input and the integrating modes of the circuit dynamics. In light of this theory, we analyzed neural population activity in the visual cortex of mice that learned to discriminate visual features. We found that over learning, slow patterns of network dynamics realigned to better integrate input relevant to the discrimination task. This realignment of network dynamics could be explained by changes in excitatory-inhibitory connectivity among neurons tuned to relevant features. These results suggest that learning tunes the temporal dynamics of cortical circuits to optimally integrate relevant sensory input.

Deep learning, reinforcement learning, and world models.

Deep learning (DL) and reinforcement learning (RL) methods seem to be a part of indispensable factors to achieve human-level or super-human AI systems. On the other hand, both DL and RL have strong connections with our brain functions and with neuroscientific findings. In this review, we summarize talks and discussions in the "Deep Learning and Reinforcement Learning" session of the symposium, International Symposium on Artificial Intelligence and Brain Science. In this session, we discussed whether we can achieve comprehensive understanding of human intelligence based on the recent advances of deep learning and reinforcement learning algorithms. Speakers contributed to provide talks about their recent studies that can be key technologies to achieve human-level intelligence.

Learning and attention increase visual response selectivity through distinct mechanisms.

Selectivity of cortical neurons for sensory stimuli can increase across days as animals learn their behavioral relevance and across seconds when animals switch attention. While both phenomena occur in the same circuit, it is unknown whether they rely on similar mechanisms. We imaged primary visual cortex as mice learned a visual discrimination task and subsequently performed an attention switching task. Selectivity changes due to learning and attention were uncorrelated in individual neurons. Selectivity increases after learning mainly arose from selective suppression of responses to one of the stimuli but from selective enhancement and suppression during attention. Learning and attention differentially affected interactions between excitatory and PV, SOM, and VIP inhibitory cells. Circuit modeling revealed that cell class-specific top-down inputs best explained attentional modulation, while reorganization of local functional connectivity accounted for learning-related changes. Thus, distinct mechanisms underlie increased discriminability of relevant sensory stimuli across longer and shorter timescales.

Dynamics on the manifold: Identifying computational dynamical activity from neural population recordings.

The question of how the collective activity of neural populations gives rise to complex behaviour is fundamental to neuroscience. At the core of this question lie considerations about how neural circuits can perform computations that enable sensory perception, decision making, and motor control. It is thought that such computations are implemented through the dynamical evolution of distributed activity in recurrent circuits. Thus, identifying dynamical structure in neural population activity is a key challenge towards a better understanding of neural computation. At the same time, interpreting this structure in light of the computation of interest is essential for linking the time-varying activity patterns of the neural population to ongoing computational processes. Here, we review methods that aim to quantify structure in neural population recordings through a dynamical system defined in a low-dimensional latent variable space. We discuss advantages and limitations of different modelling approaches and address future challenges for the field.

Dendritic calcium signals in rhesus macaque motor cortex drive an optical brain-computer interface.

Calcium imaging is a powerful tool for recording from large populations of neurons in vivo. Imaging in rhesus macaque motor cortex can enable the discovery of fundamental principles of motor cortical function and can inform the design of next generation brain-computer interfaces (BCIs). Surface two-photon imaging, however, cannot presently access somatic calcium signals of neurons from all layers of macaque motor cortex due to photon scattering. Here, we demonstrate an implant and imaging system capable of chronic, motion-stabilized two-photon imaging of neuronal calcium signals from macaques engaged in a motor task. By imaging apical dendrites, we achieved optical access to large populations of deep and superficial cortical neurons across dorsal premotor (PMd) and gyral primary motor (M1) cortices. Dendritic signals from individual neurons displayed tuning for different directions of arm movement. Combining several technical advances, we developed an optical BCI (oBCI) driven by these dendritic signalswhich successfully decoded movement direction online. By fusing two-photon functional imaging with CLARITY volumetric imaging, we verified that many imaged dendrites which contributed to oBCI decoding originated from layer 5 output neurons, including a putative Betz cell. This approach establishes new opportunities for studying motor control and designing BCIs via two photon imaging.

Sustained Activation of PV+ Interneurons in Core Auditory Cortex Enables Robust Divisive Gain Control for Complex and Naturalistic Stimuli.

Sensory cortices must flexibly adapt their operations to internal states and external requirements. Sustained modulation of activity levels in different inhibitory interneuron populations may provide network-level mechanisms for adjustment of sensory cortical processing on behaviorally relevant timescales. However, understanding of the computational roles of inhibitory interneuron modulation has mostly been restricted to effects at short timescales, through the use of phasic optogenetic activation and transient stimuli. Here, we investigated how modulation of inhibitory interneurons affects cortical computation on longer timescales, by using sustained, network-wide optogenetic activation of parvalbumin-positive interneurons (the largest class of cortical inhibitory interneurons) to study modulation of auditory cortical responses to prolonged and naturalistic as well as transient stimuli. We found highly conserved spectral and temporal tuning in auditory cortical neurons, despite a profound reduction in overall network activity. This reduction was predominantly divisive, and consistent across simple, complex, and naturalistic stimuli. A recurrent network model with power-law input-output functions replicated our results. We conclude that modulation of parvalbumin-positive interneurons on timescales typical of sustained neuromodulation may provide a means for robust divisive gain control conserving stimulus representations.

Movement initiation and grasp representation in premotor and primary motor cortex mirror neurons.

Pyramidal tract neurons (PTNs) within macaque rostral ventral premotor cortex (F5) and (M1) provide direct input to spinal circuitry and are critical for skilled movement control. Contrary to initial hypotheses, they can also be active during action observation, in the absence of any movement. A population-level understanding of this phenomenon is currently lacking. We recorded from single neurons, including identified PTNs, in (M1) (n = 187), and F5 (n = 115) as two adult male macaques executed, observed, or withheld (NoGo) reach-to-grasp actions. F5 maintained a similar representation of grasping actions during both execution and observation. In contrast, although many individual M1 neurons were active during observation, M1 population activity was distinct from execution, and more closely aligned to NoGo activity, suggesting this activity contributes to withholding of self-movement. M1 and its outputs may dissociate initiation of movement from representation of grasp in order to flexibly guide behaviour.

Perceptual bias reveals slow-updating in autism and fast-forgetting in dyslexia.

Individuals with autism and individuals with dyslexia both show reduced use of previous sensory information (stimuli statistics) in perceptual tasks, even though these are very different neurodevelopmental disorders. To better understand how past sensory information influences the perceptual experience in these disorders, we first investigated the trial-by-trial performance of neurotypical participants in a serial discrimination task. Neurotypical participants overweighted recent stimuli, revealing fast updating of internal sensory models, which is adaptive in changing environments. They also weighted the detailed stimuli distribution inferred by longer-term accumulation of stimuli statistics, which is adaptive in stable environments. Compared to neurotypical participants, individuals with dyslexia weighted earlier stimuli less heavily, whereas individuals with autism spectrum disorder weighted recent stimuli less heavily. Investigating the dynamics of perceptual inference reveals that individuals with dyslexia rely more on information about the immediate past, whereas perception in individuals with autism is dominated by longer-term statistics.

A Head-Mounted Camera System Integrates Detailed Behavioral Monitoring with Multichannel Electrophysiology in Freely Moving Mice.

Breakthroughs in understanding the neural basis of natural behavior require neural recording and intervention to be paired with high-fidelity multimodal behavioral monitoring. An extensive genetic toolkit for neural circuit dissection, and well-developed neural recording technology, make the mouse a powerful model organism for systems neuroscience. However, most methods for high-bandwidth acquisition of behavioral data in mice rely upon fixed-position cameras and other off-animal devices, complicating the monitoring of animals freely engaged in natural behaviors. Here, we report the development of a lightweight head-mounted camera system combined with head-movement sensors to simultaneously monitor eye position, pupil dilation, whisking, and pinna movements along with head motion in unrestrained, freely behaving mice. The power of the combined technology is demonstrated by observations linking eye position to head orientation; whisking to non-tactile stimulation; and, in electrophysiological experiments, visual cortical activity to volitional head movements.

Distinct learning-induced changes in stimulus selectivity and interactions of GABAergic interneuron classes in visual cortex.

How learning enhances neural representations for behaviorally relevant stimuli via activity changes of cortical cell types remains unclear. We simultaneously imaged responses of pyramidal cells (PYR) along with parvalbumin (PV), somatostatin (SOM), and vasoactive intestinal peptide (VIP) inhibitory interneurons in primary visual cortex while mice learned to discriminate visual patterns. Learning increased selectivity for task-relevant stimuli of PYR, PV and SOM subsets but not VIP cells. Strikingly, PV neurons became as selective as PYR cells, and their functional interactions reorganized, leading to the emergence of stimulus-selective PYR-PV ensembles. Conversely, SOM activity became strongly decorrelated from the network, and PYR-SOM coupling before learning predicted selectivity increases in individual PYR cells. Thus, learning differentially shapes the activity and interactions of multiple cell classes: while SOM inhibition may gate selectivity changes, PV interneurons become recruited into stimulus-specific ensembles and provide more selective inhibition as the network becomes better at discriminating behaviorally relevant stimuli.

The Impact of Anesthetic State on Spike-Sorting Success in the Cortex: A Comparison of Ketamine and Urethane Anesthesia.

Spike sorting is an essential first step in most analyses of extracellular in vivo electrophysiological recordings. Here we show that spike-sorting success depends critically on characteristics of coordinated population activity that can differ between anesthetic states. In tetrode recordings from mouse auditory cortex, spike sorting was significantly less successful under ketamine/medetomidine (ket/med) than urethane anesthesia. Surprisingly, this difficulty with sorting under ket/med anesthesia did not appear to result from either greater millisecond-scale burstiness of neural activity or increased coordination of activity among neighboring neurons. Rather, the key factor affecting sorting success appeared to be the amount of coordinated population activity at long time intervals and across large cortical distances. We propose that spike-sorting success is directly dependent on overall coordination of activity, and is most disrupted by large-scale fluctuations in cortical population activity. Reliability of single-unit recording may therefore differ not only between urethane-anesthetized and ket/med-anesthetized states as demonstrated here, but also between synchronized and desynchronized states, asleep and awake states, or inattentive and attentive states in unanesthetized animals.

Prior context in audition informs binding and shapes simple features.

A perceptual phenomenon is reported, whereby prior acoustic context has a large, rapid and long-lasting effect on a basic auditory judgement. Pairs of tones were devised to include ambiguous transitions between frequency components, such that listeners were equally likely to report an upward or downward 'pitch' shift between tones. We show that presenting context tones before the ambiguous pair almost fully determines the perceived direction of shift. The context effect generalizes to a wide range of temporal and spectral scales, encompassing the characteristics of most realistic auditory scenes. Magnetoencephalographic recordings show that a relative reduction in neural responsivity is correlated to the behavioural effect. Finally, a computational model reproduces behavioural results, by implementing a simple constraint of continuity for binding successive sounds in a probabilistic manner. Contextual processing, mediated by ubiquitous neural mechanisms such as adaptation, may be crucial to track complex sound sources over time.

The need for calcium imaging in nonhuman primates: New motor neuroscience and brain-machine interfaces.

A central goal of neuroscience is to understand how populations of neurons coordinate and cooperate in order to give rise to perception, cognition, and action. Nonhuman primates (NHPs) are an attractive model with which to understand these mechanisms in humans, primarily due to the strong homology of their brains and the cognitively sophisticated behaviors they can be trained to perform. Using electrode recordings, the activity of one to a few hundred individual neurons may be measured electrically, which has enabled many scientific findings and the development of brain-machine interfaces. Despite these successes, electrophysiology samples sparsely from neural populations and provides little information about the genetic identity and spatial micro-organization of recorded neurons. These limitations have spurred the development of all-optical methods for neural circuit interrogation. Fluorescent calcium signals serve as a reporter of neuronal responses, and when combined with post-mortem optical clearing techniques such as CLARITY, provide dense recordings of neuronal populations, spatially organized and annotated with genetic and anatomical information. Here, we advocate that this methodology, which has been of tremendous utility in smaller animal models, can and should be developed for use with NHPs. We review here several of the key opportunities and challenges for calcium-based optical imaging in NHPs. We focus on motor neuroscience and brain-machine interface design as representative domains of opportunity within the larger field of NHP neuroscience.

Inhibitory control of correlated intrinsic variability in cortical networks.

Cortical networks exhibit intrinsic dynamics that drive coordinated, large-scale fluctuations across neuronal populations and create noise correlations that impact sensory coding. To investigate the network-level mechanisms that underlie these dynamics, we developed novel computational techniques to fit a deterministic spiking network model directly to multi-neuron recordings from different rodent species, sensory modalities, and behavioral states. The model generated correlated variability without external noise and accurately reproduced the diverse activity patterns in our recordings. Analysis of the model parameters suggested that differences in noise correlations across recordings were due primarily to differences in the strength of feedback inhibition. Further analysis of our recordings confirmed that putative inhibitory neurons were indeed more active during desynchronized cortical states with weak noise correlations. Our results demonstrate that network models with intrinsically-generated variability can accurately reproduce the activity patterns observed in multi-neuron recordings and suggest that inhibition modulates the interactions between intrinsic dynamics and sensory inputs to control the strength of noise correlations.

Subliminal stimulation and somatosensory signal detection.

Only a small fraction of sensory signals is consciously perceived. The brain's perceptual systems may include mechanisms of feedforward inhibition that protect the cortex from subliminal noise, thus reserving cortical capacity and conscious awareness for significant stimuli. Here we provide a new view of these mechanisms based on signal detection theory, and gain control. We demonstrated that subliminal somatosensory stimulation decreased sensitivity for the detection of a subsequent somatosensory input, largely due to increased false alarm rates. By delivering the subliminal somatosensory stimulus and the to-be-detected somatosensory stimulus to different digits of the same hand, we show that this effect spreads across the sensory surface. In addition, subliminal somatosensory stimulation tended to produce an increased probability of responding "yes", whether the somatosensory stimulus was present or not. Our results suggest that subliminal stimuli temporarily reduce input gain, avoiding excessive responses to further small inputs. This gain control may be automatic, and may precede discriminative classification of inputs into signals or noise. Crucially, we found that subliminal inputs influenced false alarm rates only on blocks where the to-be-detected stimuli were present, and not on pre-test control blocks where they were absent. Participants appeared to adjust their perceptual criterion according to a statistical distribution of stimuli in the current context, with the presence of supraliminal stimuli having an important role in the criterion-setting process. These findings clarify the cognitive mechanisms that reserve conscious perception for salient and important signals.

Input-Specific Gain Modulation by Local Sensory Context Shapes Cortical and Thalamic Responses to Complex Sounds.

Sensory neurons are customarily characterized by one or more linearly weighted receptive fields describing sensitivity in sensory space and time. We show that in auditory cortical and thalamic neurons, the weight of each receptive field element depends on the pattern of sound falling within a local neighborhood surrounding it in time and frequency. Accounting for this change in effective receptive field with spectrotemporal context improves predictions of both cortical and thalamic responses to stationary complex sounds. Although context dependence varies among neurons and across brain areas, there are strong shared qualitative characteristics. In a spectrotemporally rich soundscape, sound elements modulate neuronal responsiveness more effectively when they coincide with sounds at other frequencies, and less effectively when they are preceded by sounds at similar frequencies. This local-context-driven lability in the representation of complex sounds-a modulation of "input-specific gain" rather than "output gain"-may be a widespread motif in sensory processing.

Models of Neuronal Stimulus-Response Functions: Elaboration, Estimation, and Evaluation.

Rich, dynamic, and dense sensory stimuli are encoded within the nervous system by the time-varying activity of many individual neurons. A fundamental approach to understanding the nature of the encoded representation is to characterize the function that relates the moment-by-moment firing of a neuron to the recent history of a complex sensory input. This review provides a unifying and critical survey of the techniques that have been brought to bear on this effort thus far-ranging from the classical linear receptive field model to modern approaches incorporating normalization and other nonlinearities. We address separately the structure of the models; the criteria and algorithms used to identify the model parameters; and the role of regularizing terms or "priors." In each case we consider benefits or drawbacks of various proposals, providing examples for when these methods work and when they may fail. Emphasis is placed on key concepts rather than mathematical details, so as to make the discussion accessible to readers from outside the field. Finally, we review ways in which the agreement between an assumed model and the neuron's response may be quantified. Re-implemented and unified code for many of the methods are made freely available.

Learning Enhances Sensory and Multiple Non-sensory Representations in Primary Visual Cortex.

We determined how learning modifies neural representations in primary visual cortex (V1) during acquisition of a visually guided behavioral task. We imaged the activity of the same layer 2/3 neuronal populations as mice learned to discriminate two visual patterns while running through a virtual corridor, where one pattern was rewarded. Improvements in behavioral performance were closely associated with increasingly distinguishable population-level representations of task-relevant stimuli, as a result of stabilization of existing and recruitment of new neurons selective for these stimuli. These effects correlated with the appearance of multiple task-dependent signals during learning: those that increased neuronal selectivity across the population when expert animals engaged in the task, and those reflecting anticipation or behavioral choices specifically in neuronal subsets preferring the rewarded stimulus. Therefore, learning engages diverse mechanisms that modify sensory and non-sensory representations in V1 to adjust its processing to task requirements and the behavioral relevance of visual stimuli.