Oculomotor plant and neural dynamics suggest gaze control requires integration on distributed timescales.

A fundamental principle of biological motor control is that the neural commands driving movement must conform to the response properties of the motor plants they control. In the oculomotor system, characterizations of oculomotor plant dynamics traditionally supported models in which the plant responds to neural drive to extraocular muscles on exclusively short, subsecond timescales. These models predict that the stabilization of gaze during fixations between saccades requires neural drive that approximates eye position on longer timescales and is generated through the temporal integration of brief eye velocity-encoding signals that cause saccades. However, recent measurements of oculomotor plant behaviour have revealed responses on longer timescales. Furthermore, measurements of firing patterns in the oculomotor integrator have revealed a more complex encoding of eye movement dynamics. Yet, the link between these observations has remained unclear. Here we use measurements from the larval zebrafish to link dynamics in the oculomotor plant to dynamics in the neural integrator. The oculomotor plant in both anaesthetized and awake larval zebrafish was characterized by a broad distribution of response timescales, including those much longer than 1 s. Analysis of the firing patterns of oculomotor integrator neurons, which exhibited a broadly distributed range of decay time constants, demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with distributed response timescales. This work suggests that leaky integration on multiple, distributed timescales by the oculomotor integrator reflects an inverse model for generating oculomotor commands, and that multi-timescale dynamics may be a general feature of motor circuitry. KEY POINTS: Recent observations of oculomotor plant response properties and neural activity across the oculomotor system have called into question classical formulations of both the oculomotor plant and the oculomotor integrator. Here we use measurements from new and published experiments in the larval zebrafish together with modelling to reconcile recent oculomotor plant observations with oculomotor integrator function. We developed computational techniques to characterize oculomotor plant responses over several seconds in awake animals, demonstrating that long timescale responses seen in anaesthetized animals extend to the awake state. Analysis of firing patterns of oculomotor integrator neurons demonstrates the sufficiency of this activity for stabilizing gaze given an oculomotor plant with multiple, distributed response timescales. Our results support a formulation of gaze stabilization by the oculomotor system in which commands for stabilizing gaze are generated through integration on multiple, distributed timescales.

Synchronization of Electrically Coupled Resonate-and-Fire Neurons.

Electrical coupling between neurons is broadly present across brain areas and is typically assumed to synchronize network activity. However, intrinsic properties of the coupled cells can complicate this simple picture. Many cell types with electrical coupling show a diversity of post-spike subthreshold fluctuations, often linked to subthreshold resonance, which are transmitted through electrical synapses in addition to action potentials. Using the theory of weakly coupled oscillators, we explore the effect of both subthreshold and spike-mediated coupling on synchrony in small networks of electrically coupled resonate-and-fire neurons, a hybrid neuron model with damped subthreshold oscillations and a range of post-spike voltage dynamics. We calculate the phase response curve using an extension of the adjoint method that accounts for the discontinuous post-spike reset rule. We find that both spikes and subthreshold fluctuations can jointly promote synchronization. The subthreshold contribution is strongest when the voltage exhibits a significant post-spike elevation in voltage, or plateau potential. Additionally, we show that the geometry of trajectories approaching the spiking threshold causes a "reset-induced shear" effect that can oppose synchrony in the presence of network asymmetry, despite having no effect on the phase-locking of symmetrically coupled pairs.

Balanced cortical microcircuitry for spatial working memory based on corrective feedback control.

A hallmark of working memory is the ability to maintain graded representations of both the spatial location and amplitude of a memorized stimulus. Previous work has identified a neural correlate of spatial working memory in the persistent maintenance of spatially specific patterns of neural activity. How such activity is maintained by neocortical circuits remains unknown. Traditional models of working memory maintain analog representations of either the spatial location or the amplitude of a stimulus, but not both. Furthermore, although most previous models require local excitation and lateral inhibition to maintain spatially localized persistent activity stably, the substrate for lateral inhibitory feedback pathways is unclear. Here, we suggest an alternative model for spatial working memory that is capable of maintaining analog representations of both the spatial location and amplitude of a stimulus, and that does not rely on long-range feedback inhibition. The model consists of a functionally columnar network of recurrently connected excitatory and inhibitory neural populations. When excitation and inhibition are balanced in strength but offset in time, drifts in activity trigger spatially specific negative feedback that corrects memory decay. The resulting networks can temporally integrate inputs at any spatial location, are robust against many commonly considered perturbations in network parameters, and, when implemented in a spiking model, generate irregular neural firing characteristic of that observed experimentally during persistent activity. This work suggests balanced excitatory-inhibitory memory circuits implementing corrective negative feedback as a substrate for spatial working memory.

NMDA and GABAB (KIR) conductances: the "perfect couple" for bistability.

Networks that produce persistent firing in response to novel input patterns are thought to be important in working memory and other information storage functions. One possible mechanism for maintaining persistent firing is dendritic voltage bistability in which the depolarized state depends on the voltage dependence of the NMDA conductance at recurrent synapses. In previous models, the hyperpolarized state is dependent on voltage-independent conductances, including GABA(A). The interplay of these conductances leads to bistability, but its robustness is limited by the fact that the conductance ratio must be within a narrow range. The GABA(B) component of inhibitory transmission was not considered in previous analyses. Here, we show that the voltage dependence of the inwardly rectifying potassium (KIR) conductance activated by GABA(B) receptors adds substantial robustness to network simulations of bistability and the persistent firing that it underlies. The hyperpolarized state is robust because, at hyperpolarized potentials, the GABA(B)/KIR conductance is high and the NMDA conductance is low; the depolarized state is robust because, at depolarized potentials, the NMDA conductance is high and the GABA(B)/KIR conductance is low. Our results suggest that this complementary voltage dependence of GABA(B)/KIR and NMDA conductances makes them a "perfect couple" for producing voltage bistability.

Parental depression confers greater prospective depression risk to females than males in emerging adulthood.

Females are at greater risk of depression than males, a pattern arising in adolescence and continuing in adulthood. One hypothesis is that major risk factors operate more robustly for females. We tested whether parental depression history imposes greater prospective depression risk for female emerging adults in a large community sample (ages 18-19, N = 637). Utilizing linear mixed regressions to model symptom changes over 2 years, we found the predictive utility of parental depression varied by gender. Females had higher depression symptoms overall, and those with parental depression remained at high levels throughout the adulthood transition, compared to at-risk males whose elevated symptoms decreased. This effect was specific to offspring depression (versus anxiety) and was found only for parental depression (versus other disorders). Female emerging adults with a parental depression history are at increased risk for future depression symptom elevations, which may partially explain their increased risk for depressive disorders in adulthood.

Synaptic weight dynamics underlying memory consolidation: implications for learning rules, circuit organization, and circuit function.

Systems consolidation is a common feature of learning and memory systems, in which a long-term memory initially stored in one brain region becomes persistently stored in another region. We studied the dynamics of systems consolidation in simple circuit architectures with two sites of plasticity, one in an early-learning and one in a late-learning brain area. We show that the synaptic dynamics of the circuit during consolidation of an analog memory can be understood as a temporal integration process, by which transient changes in activity driven by plasticity in the early-learning area are accumulated into persistent synaptic changes at the late-learning site. This simple principle naturally leads to a speed-accuracy tradeoff in systems consolidation and provides insight into how the circuit mitigates the stability-plasticity dilemma of storing new memories while preserving core features of older ones. Furthermore, it imposes two constraints on the circuit. First, the plasticity rule at the late-learning site must stably support a continuum of possible outputs for a given input. We show that this is readily achieved by heterosynaptic but not standard Hebbian rules. Second, to turn off the consolidation process and prevent erroneous changes at the late-learning site, neural activity in the early-learning area must be reset to its baseline activity. We propose two biologically plausible implementations for this reset that suggest novel roles for core elements of the cerebellar circuit. Significance Statement: How are memories transformed over time? We propose a simple organizing principle for how long term memories are moved from an initial to a final site of storage. We show that successful transfer occurs when the late site of memory storage is endowed with synaptic plasticity rules that stably accumulate changes in activity occurring at the early site of memory storage. We instantiate this principle in a simple computational model that is representative of brain circuits underlying a variety of behaviors. The model suggests how a neural circuit can store new memories while preserving core features of older ones, and suggests novel roles for core elements of the cerebellar circuit.

A Lyapunov theory demonstrating a fundamental limit on the speed of systems consolidation.

The nervous system reorganizes memories from an early site to a late site, a commonly observed feature of learning and memory systems known as systems consolidation. Previous work has suggested learning rules by which consolidation may occur. Here, we provide conditions under which such rules are guaranteed to lead to stable convergence of learning and consolidation. We use the theory of Lyapunov functions, which enforces stability by requiring learning rules to decrease an energy-like (Lyapunov) function. We present the theory in the context of a simple circuit architecture motivated by classic models of learning in systems consolidation mediated by the cerebellum. Stability is only guaranteed if the learning rate in the late stage is not faster than the learning rate in the early stage. Further, the slower the learning rate at the late stage, the larger the perturbation the system can tolerate with a guarantee of stability. We provide intuition for this result by mapping the consolidation model to a damped driven oscillator system, and showing that the ratio of early-to late-stage learning rates in the consolidation model can be directly identified with the (square of the) oscillator's damping ratio. This work suggests the power of the Lyapunov approach to provide constraints on nervous system function.

Interactions between circuit architecture and plasticity in a closed-loop cerebellar system.

Determining the sites and directions of plasticity underlying changes in neural activity and behavior is critical for understanding mechanisms of learning. Identifying such plasticity from neural recording data can be challenging due to feedback pathways that impede reasoning about cause and effect. We studied interactions between feedback, neural activity, and plasticity in the context of a closed-loop motor learning task for which there is disagreement about the loci and directions of plasticity: vestibulo-ocular reflex learning. We constructed a set of circuit models that differed in the strength of their recurrent feedback, from no feedback to very strong feedback. Despite these differences, each model successfully fit a large set of neural and behavioral data. However, the patterns of plasticity predicted by the models fundamentally differed, with the direction of plasticity at a key site changing from depression to potentiation as feedback strength increased. Guided by our analysis, we suggest how such models can be experimentally disambiguated. Our results address a long-standing debate regarding cerebellum-dependent motor learning, suggesting a reconciliation in which learning-related changes in the strength of synaptic inputs to Purkinje cells are compatible with seemingly oppositely directed changes in Purkinje cell spiking activity. More broadly, these results demonstrate how changes in neural activity over learning can appear to contradict the sign of the underlying plasticity when either internal feedback or feedback through the environment is present.

Context-dependence of deterministic and nondeterministic contributions to closed-loop steering control.

In natural circumstances, sensory systems operate in a closed loop with motor output, whereby actions shape subsequent sensory experiences. A prime example of this is the sensorimotor processing required to align one's direction of travel, or heading, with one's goal, a behavior we refer to as steering. In steering, motor outputs work to eliminate errors between the direction of heading and the goal, modifying subsequent errors in the process. The closed-loop nature of the behavior makes it challenging to determine how deterministic and nondeterministic processes contribute to behavior. We overcome this by applying a nonparametric, linear kernel-based analysis to behavioral data of monkeys steering through a virtual environment in two experimental contexts. In a given context, the results were consistent with previous work that described the transformation as a second-order linear system. Classically, the parameters of such second-order models are associated with physical properties of the limb such as viscosity and stiffness that are commonly assumed to be approximately constant. By contrast, we found that the fit kernels differed strongly across tasks in these and other parameters, suggesting context-dependent changes in neural and biomechanical processes. We additionally fit residuals to a simple noise model and found that the form of the noise was highly conserved across both contexts and animals. Strikingly, the fitted noise also closely matched that found previously in a human steering task. Altogether, this work presents a kernel-based analysis that characterizes the context-dependence of deterministic and non-deterministic components of a closed-loop sensorimotor task.

An oscillatory mechanism for multi-level storage in short-term memory.

Oscillatory activity is commonly observed during the maintenance of information in short-term memory, but its role remains unclear. Non-oscillatory models of short-term memory storage are able to encode stimulus identity through their spatial patterns of activity, but are typically limited to either an all-or-none representation of stimulus amplitude or exhibit a biologically implausible exact-tuning condition. Here we demonstrate a simple mechanism by which oscillatory input enables a circuit to generate persistent or sequential activity that encodes information not only in the spatial pattern of activity, but also in the amplitude of activity. This is accomplished through a phase-locking phenomenon that permits many different amplitudes of persistent activity to be stored without requiring exact tuning of model parameters. Altogether, this work proposes a class of models for the storage of information in working memory, a potential role for brain oscillations, and a dynamical mechanism for maintaining multi-stable neural representations.

Neural circuit models for evidence accumulation through choice-selective sequences.

Decision making is traditionally thought to be mediated by populations of neurons whose firing rates persistently accumulate evidence across time. However, recent decision-making experiments in rodents have observed neurons across the brain that fire sequentially as a function of spatial position or time, rather than persistently, with the subset of neurons in the sequence depending on the animal's choice. We develop two new candidate circuit models, in which evidence is encoded either in the relative firing rates of two competing chains of neurons or in the network location of a stereotyped pattern ("bump") of neural activity. Encoded evidence is then faithfully transferred between neuronal populations representing different positions or times. Neural recordings from four different brain regions during a decision-making task showed that, during the evidence accumulation period, different brain regions displayed tuning curves consistent with different candidate models for evidence accumulation. This work provides mechanistic models and potential neural substrates for how graded-value information may be precisely accumulated within and transferred between neural populations, a set of computations fundamental to many cognitive operations.

Cyclic structure with cellular precision in a vertebrate sensorimotor neural circuit.

Neuronal wiring diagrams reconstructed by electron microscopy1,2,3,4,5 pose new questions about the organization of nervous systems following the time-honored tradition of cross-species comparisons.6,7 The C. elegans connectome has been conceptualized as a sensorimotor circuit that is approximately feedforward,8,9,10,11 starting from sensory neurons proceeding to interneurons and ending with motor neurons. Overrepresentation of a 3-cell motif often known as the "feedforward loop" has provided further evidence for feedforwardness.10,12 Here, we contrast with another sensorimotor wiring diagram that was recently reconstructed from a larval zebrafish brainstem.13 We show that the 3-cycle, another 3-cell motif, is highly overrepresented in the oculomotor module of this wiring diagram. This is a first for any neuronal wiring diagram reconstructed by electron microscopy, whether invertebrate12,14 or mammalian.15,16,17 The 3-cycle of cells is "aligned" with a 3-cycle of neuronal groups in a stochastic block model (SBM)18 of the oculomotor module. However, the cellular cycles exhibit more specificity than can be explained by the group cycles-recurrence to the same neuron is surprisingly common. Cyclic structure could be relevant for theories of oculomotor function that depend on recurrent connectivity. The cyclic structure coexists with the classic vestibulo-ocular reflex arc for horizontal eye movements,19 and could be relevant for recurrent network models of temporal integration by the oculomotor system.20,21.

Noise tolerance of attractor and feedforward memory models.

In short-term memory networks, transient stimuli are represented by patterns of neural activity that persist long after stimulus offset. Here, we compare the performance of two prominent classes of memory networks, feedback-based attractor networks and feedforward networks, in conveying information about the amplitude of a briefly presented stimulus in the presence of gaussian noise. Using Fisher information as a metric of memory performance, we find that the optimal form of network architecture depends strongly on assumptions about the forms of nonlinearities in the network. For purely linear networks, we find that feedforward networks outperform attractor networks because noise is continually removed from feedforward networks when signals exit the network; as a result, feedforward networks can amplify signals they receive faster than noise accumulates over time. By contrast, attractor networks must operate in a signal-attenuating regime to avoid the buildup of noise. However, if the amplification of signals is limited by a finite dynamic range of neuronal responses or if noise is reset at the time of signal arrival, as suggested by recent experiments, we find that attractor networks can outperform feedforward ones. Under a simple model in which neurons have a finite dynamic range, we find that the optimal attractor networks are forgetful if there is no mechanism for noise reduction with signal arrival but nonforgetful (perfect integrators) in the presence of a strong reset mechanism. Furthermore, we find that the maximal Fisher information for the feedforward and attractor networks exhibits power law decay as a function of time and scales linearly with the number of neurons. These results highlight prominent factors that lead to trade-offs in the memory performance of networks with different architectures and constraints, and suggest conditions under which attractor or feedforward networks may be best suited to storing information about previous stimuli.

Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning.

How are actions linked with subsequent outcomes to guide choices? The nucleus accumbens, which is implicated in this process, receives glutamatergic inputs from the prelimbic cortex and midline regions of the thalamus. However, little is known about whether and how representations differ across these input pathways. By comparing these inputs during a reinforcement learning task in mice, we discovered that prelimbic cortical inputs preferentially represent actions and choices, whereas midline thalamic inputs preferentially represent cues. Choice-selective activity in the prelimbic cortical inputs is organized in sequences that persist beyond the outcome. Through computational modeling, we demonstrate that these sequences can support the neural implementation of reinforcement-learning algorithms, in both a circuit model based on synaptic plasticity and one based on neural dynamics. Finally, we test and confirm a prediction of our circuit models by direct manipulation of nucleus accumbens input neurons.

Should the reorganization of addiction-related research across all the National Institutes of Health be structural?--The devil is truly in the details.

The recent proposal to dissolve the National Institute on Alcohol Abuse and Alcoholism and National Institute on Drug Abuse and create a new institute for substance use, abuse, and addiction will require significant effort by the staff of both institutes, the Advisory Councils, and outside experts to overcome complex challenges that could threaten its success. Although integration of the grants portfolios can be achieved, harmonization of goals and policies related to legal use of alcohol versus illegal consumption of drugs will present serious challenges. Consolidating the infrastructure of the 2 existing institutes would entail avoiding encroachment on grant funding. A new institute for substance use, abuse, and addiction would require an enormous amount of cooperation from other institutes as the portfolios of research on alcohol, tobacco, and other drug abuse should logically be transferred to the new institute. In the near term, a structural reorganization would be less efficient and more costly than the individual institutes are currently. Increasing efficiency and reducing costs over time will necessitate careful strategic planning. Success in this difficult task would be made easier and less costly by first implementing carefully placed building blocks of increasing functional reorganization. The newly created institute should increase opportunities for specialization within disorders of addiction, attract new leadership, and build a novel strategic plan that will energize scientists and staff and incorporate ideas of stakeholders to advance the public good in preventing and treating alcohol, tobacco, and all addictions. Attention must be paid to the devil in the details.

Functional dissection of circuitry in a neural integrator.

In neural integrators, transient inputs are accumulated into persistent firing rates that are a neural correlate of short-term memory. Integrators often contain two opposing cell populations that increase and decrease sustained firing as a stored parameter value rises. A leading hypothesis for the mechanism of persistence is positive feedback through mutual inhibition between these opposing populations. We tested predictions of this hypothesis in the goldfish oculomotor velocity-to-position integrator by measuring the eye position and firing rates of one population, while pharmacologically silencing the opposing one. In complementary experiments, we measured responses in a partially silenced single population. Contrary to predictions, induced drifts in neural firing were limited to half of the oculomotor range. We built network models with synaptic-input thresholds to demonstrate a new hypothesis suggested by these data: mutual inhibition between the populations does not provide positive feedback in support of integration, but rather coordinates persistent activity intrinsic to each population.

Combining Microbial Culturing With Mathematical Modeling in an Introductory Course-Based Undergraduate Research Experience.

Quantitative techniques are a critical part of contemporary biology research, but students interested in biology enter college with widely varying quantitative skills and attitudes toward mathematics. Course-based undergraduate research experiences (CUREs) may be an early way to build student competency and positive attitudes. Here we describe the design, implementation, and assessment of an introductory quantitative CURE focused on halophilic microbes. In this CURE, students culture and isolate halophilic microbes from environmental and food samples, perform growth assays, then use mathematical modeling to quantify the growth rate of strains in different salinities. To assess how the course may impact students' future academic plans and attitudes toward the use of math in biology, we used pre- and post-quarter surveys. Students who completed the course showed more positive attitudes toward science learning and an increased interest in pursuing additional quantitative biology experiences. We argue that the classroom application of microbiology methods, combined with mathematical modeling using student-generated data, provides a degree of student ownership, collaboration, iteration, and discovery that makes quantitative learning both relevant and exciting to students.

Tuning curves, neuronal variability, and sensory coding.

Tuning curves are widely used to characterize the responses of sensory neurons to external stimuli, but there is an ongoing debate as to their role in sensory processing. Commonly, it is assumed that a neuron's role is to encode the stimulus at the tuning curve peak, because high firing rates are the neuron's most distinct responses. In contrast, many theoretical and empirical studies have noted that nearby stimuli are most easily discriminated in high-slope regions of the tuning curve. Here, we demonstrate that both intuitions are correct, but that their relative importance depends on the experimental context and the level of variability in the neuronal response. Using three different information-based measures of encoding applied to experimentally measured sensory neurons, we show how the best-encoded stimulus can transition from high-slope to high-firing-rate regions of the tuning curve with increasing noise level. We further show that our results are consistent with recent experimental findings that correlate neuronal sensitivities with perception and behavior. This study illustrates the importance of the noise level in determining the encoding properties of sensory neurons and provides a unified framework for interpreting how the tuning curve and neuronal variability relate to the overall role of the neuron in sensory encoding.

Alcohol expectancies and reactivity to alcohol-related and affective cues.

Recent conceptualizations of alcohol expectancies relate cognitive schemas to their neurobiological underpinnings; cue reactivity paradigms lend themselves well to testing this broadened conceptual framework. In the present study, we examined the relationship between self-reported alcohol expectancies and responses to alcohol-related and affective picture cues among fifty-five young adults. In addition to traditional subjective and psychophysiological indices of cue reactivity, the startle eyeblink reflex was obtained during picture cue presentations to address both attention-arousal (early probes) and affective-motivational (late probes) aspects of cue processing. Analyses indicated that participants reporting greater positive, arousing, and social alcohol expectancies rated alcohol cues as more pleasant, arousing, and craving-inducing. In addition, participants displayed inhibited startle reactivity to late alcohol cue probes, indicative of an appetitive reaction. Finally, startle responding to early probes indicated that participants with greater alcohol expectancies displayed blunted attention to negative affect cues. Findings are discussed in terms of the utility of the startle reflex and cue reactivity paradigms for clarifying the relationship between alcohol expectancies and motivated attention to salient cues.

Using future-oriented expectancy associates to probe real-time variations in motivation to consume alcohol.

An extensive empirical and theoretical literature has characterized anticipatory/expectancy processes as integral to motivation, including motivation to consume alcohol. To examine whether these processes could be probed on a moment to moment basis as they activate to motivate near term drinking, we sampled future-oriented expectancy verbal associates (i.e., self-generated words) using an ecological momentary assessment (EMA) paradigm every 3 hr on 3 days of the week (2 days of likely drinking and 1 of low drinking likelihood). Expectancy associates were chosen because cognitive psychologists consider verbal items collected in this manner a part-way approach to measurement of automatic/implicit processes. Consistent with predictions, more positively valenced alcohol expectancies activated within a few hours preceding increased alcohol consumption, and this activation could be statistically distinguished from the influence of a wide array of other variables known to predict consumption, including autocorrelation. As previously observed, more positively valenced alcohol expectancies were activated in alcohol-related environments. These findings provide further evidence that anticipatory information processing is engaged for the direction of future behavior, and that probing expectancies in real-time can be useful for predicting near-term alcohol consumption. (PsycINFO Database Record (c) 2019 APA, all rights reserved).