Gait signature changes with walking speed are similar among able-bodied young adults despite persistent individual-specific differences.

Understanding individuals' distinct movement patterns is crucial for health, rehabilitation, and sports. Recently, we developed a machine learning-based framework to show that "gait signatures" describing the neuromechanical dynamics governing able-bodied and post-stroke gait kinematics remain individual-specific across speeds. However, we only evaluated gait signatures within a limited speed range and number of participants, using only sagittal plane (i.e., 2D) joint angles. Here we characterized changes in gait signatures across a wide range of speeds, from very slow (0.3 m/s) to exceptionally fast (above the walk-to-run transition speed) in 17 able-bodied young adults. We further assessed whether 3D kinematic and/or kinetic (ground reaction forces, joint moments, and powers) data would improve the discrimination of gait signatures. Our study showed that gait signatures remained individual-specific across walking speeds: Notably, 3D kinematic signatures achieved exceptional accuracy (99.8%, confidence interval (CI): 99.1-100%) in classifying individuals, surpassing both 2D kinematics and 3D kinetics. Moreover, participants exhibited consistent, predictable linear changes in their gait signatures across the entire speed range. These changes were associated with participants' preferred walking speeds, balance ability, cadence, and step length. These findings support gait signatures as a tool to characterize individual differences in gait and predict speed-induced changes in gait dynamics.

Discovering individual-specific gait signatures from data-driven models of neuromechanical dynamics.

Locomotion results from the interactions of highly nonlinear neural and biomechanical dynamics. Accordingly, understanding gait dynamics across behavioral conditions and individuals based on detailed modeling of the underlying neuromechanical system has proven difficult. Here, we develop a data-driven and generative modeling approach that recapitulates the dynamical features of gait behaviors to enable more holistic and interpretable characterizations and comparisons of gait dynamics. Specifically, gait dynamics of multiple individuals are predicted by a dynamical model that defines a common, low-dimensional, latent space to compare group and individual differences. We find that highly individualized dynamics-i.e., gait signatures-for healthy older adults and stroke survivors during treadmill walking are conserved across gait speed. Gait signatures further reveal individual differences in gait dynamics, even in individuals with similar functional deficits. Moreover, components of gait signatures can be biomechanically interpreted and manipulated to reveal their relationships to observed spatiotemporal joint coordination patterns. Lastly, the gait dynamics model can predict the time evolution of joint coordination based on an initial static posture. Our gait signatures framework thus provides a generalizable, holistic method for characterizing and predicting cyclic, dynamical motor behavior that may generalize across species, pathologies, and gait perturbations.

Driving singing behaviour in songbirds using a multi-modal, multi-agent virtual environment.

Interactive biorobotics provides unique experimental potential to study the mechanisms underlying social communication but is limited by our ability to build expressive robots that exhibit the complex behaviours of birds and small mammals. An alternative to physical robots is to use virtual environments. Here, we designed and built a modular, audio-visual 2D virtual environment that allows multi-modal, multi-agent interaction to study mechanisms underlying social communication. The strength of the system is an implementation based on event processing that allows for complex computation. We tested this system in songbirds, which provide an exceptionally powerful and tractable model system to study social communication. We show that pair-bonded zebra finches (Taeniopygia guttata) communicating through the virtual environment exhibit normal call timing behaviour, males sing female directed song and both males and females display high-intensity courtship behaviours to their mates. These results suggest that the environment provided is sufficiently natural to elicit these behavioral responses. Furthermore, as an example of complex behavioral annotation, we developed a fully unsupervised song motif detector and used it to manipulate the virtual social environment of male zebra finches based on the number of motifs sung. Our virtual environment represents a first step in real-time automatic behaviour annotation and animal-computer interaction using higher level behaviours such as song. Our unsupervised acoustic analysis eliminates the need for annotated training data thus reducing labour investment and experimenter bias.

Bottlenecks, Modularity, and the Neural Control of Behavior.

In almost all animals, the transfer of information from the brain to the motor circuitry is facilitated by a relatively small number of neurons, leading to a constraint on the amount of information that can be transmitted. Our knowledge of how animals encode information through this pathway, and the consequences of this encoding, however, is limited. In this study, we use a simple feed-forward neural network to investigate the consequences of having such a bottleneck and identify aspects of the network architecture that enable robust information transfer. We are able to explain some recently observed properties of descending neurons-that they exhibit a modular pattern of connectivity and that their excitation leads to consistent alterations in behavior that are often dependent upon the desired behavioral state of the animal. Our model predicts that in the presence of an information bottleneck, such a modular structure is needed to increase the efficiency of the network and to make it more robust to perturbations. However, it does so at the cost of an increase in state-dependent effects. Despite its simplicity, our model is able to provide intuition for the trade-offs faced by the nervous system in the presence of an information processing constraint and makes predictions for future experiments.

Social experience alters oxytocinergic modulation in the nucleus accumbens of female prairie voles.

Social relationships are dynamic and evolve with shared and personal experiences. Whether the functional role of social neuromodulators also evolves with experience to shape the trajectory of relationships is unknown. We utilized pair bonding in the socially monogamous prairie vole as an example of socio-sexual experience that dramatically alters behaviors displayed toward other individuals. We investigated oxytocin-dependent modulation of excitatory synaptic transmission in the nucleus accumbens as a function of pair-bonding status. We found that an oxytocin receptor agonist decreases the amplitude of spontaneous excitatory postsynaptic currents (sEPSCs) in sexually naive virgin, but not pair-bonded, female voles, while it increases the amplitude of electrically evoked EPSCs in paired voles, but not in virgins. This oxytocin-induced potentiation of synaptic transmission relies on the de novo coupling between oxytocin receptor signaling and endocannabinoid receptor type 1 (CB1) receptor signaling in pair-bonded voles. Blocking CB1 receptors after pair-bond formation increases the occurrence of a specific form of social rejection-defensive upright response-that is displayed toward the partner, but not toward a novel individual. Altogether, our results demonstrate that oxytocin's action in the nucleus accumbens is changed through social experience in a way that regulates the trajectory of social interactions as the relationship with the partner unfolds, potentially promoting the maintenance of a pair bond by inhibiting aggressive responses. These results provide a mechanism by which social experience and context shift oxytocinergic signaling to impact neural and behavioral responses to social cues.

Measuring the repertoire of age-related behavioral changes in Drosophila melanogaster.

Aging affects almost all aspects of an organism-its morphology, its physiology, its behavior. Isolating which biological mechanisms are regulating these changes, however, has proven difficult, potentially due to our inability to characterize the full repertoire of an animal's behavior across the lifespan. Using data from fruit flies (D. melanogaster) we measure the full repertoire of behaviors as a function of age. We observe a sexually dimorphic pattern of changes in the behavioral repertoire during aging. Although the stereotypy of the behaviors and the complexity of the repertoire overall remains relatively unchanged, we find evidence that the observed alterations in behavior can be explained by changing the fly's overall energy budget, suggesting potential connections between metabolism, aging, and behavior.

A framework for studying behavioral evolution by reconstructing ancestral repertoires.

Although different animal species often exhibit extensive variation in many behaviors, typically scientists examine one or a small number of behaviors in any single study. Here, we propose a new framework to simultaneously study the evolution of many behaviors. We measured the behavioral repertoire of individuals from six species of fruit flies using unsupervised techniques and identified all stereotyped movements exhibited by each species. We then fit a Generalized Linear Mixed Model to estimate the intra- and inter-species behavioral covariances, and, by using the known phylogenetic relationships among species, we estimated the (unobserved) behaviors exhibited by ancestral species. We found that much of intra-specific behavioral variation has a similar covariance structure to previously described long-time scale variation in an individual's behavior, suggesting that much of the measured variation between individuals of a single species in our assay reflects differences in the status of neural networks, rather than genetic or developmental differences between individuals. We then propose a method to identify groups of behaviors that appear to have evolved in a correlated manner, illustrating how sets of behaviors, rather than individual behaviors, likely evolved. Our approach provides a new framework for identifying co-evolving behaviors and may provide new opportunities to study the mechanistic basis of behavioral evolution.

Continuous Whole-Body 3D Kinematic Recordings across the Rodent Behavioral Repertoire.

In mammalian animal models, high-resolution kinematic tracking is restricted to brief sessions in constrained environments, limiting our ability to probe naturalistic behaviors and their neural underpinnings. To address this, we developed CAPTURE (Continuous Appendicular and Postural Tracking Using Retroreflector Embedding), a behavioral monitoring system that combines motion capture and deep learning to continuously track the 3D kinematics of a rat's head, trunk, and limbs for week-long timescales in freely behaving animals. CAPTURE realizes 10- to 100-fold gains in precision and robustness compared with existing convolutional network approaches to behavioral tracking. We demonstrate CAPTURE's ability to comprehensively profile the kinematics and sequential organization of natural rodent behavior, its variation across individuals, and its perturbation by drugs and disease, including identifying perseverative grooming states in a rat model of fragile X syndrome. CAPTURE significantly expands the range of behaviors and contexts that can be quantitatively investigated, opening the door to a new understanding of natural behavior and its neural basis.

Application of the hierarchical bootstrap to multi-level data in neuroscience.

A common feature in many neuroscience datasets is the presence of hierarchical data structures, most commonly recording the activity of multiple neurons in multiple animals across multiple trials. Accordingly, the measurements constituting the dataset are not independent, even though the traditional statistical analyses often applied in such cases (e.g., Student's t-test) treat them as such. The hierarchical bootstrap has been shown to be an effective tool to accurately analyze such data and while it has been used extensively in the statistical literature, its use is not widespread in neuroscience - despite the ubiquity of hierarchical datasets. In this paper, we illustrate the intuitiveness and utility of this approach to analyze hierarchically nested datasets. We use simulated neural data to show that traditional statistical tests can result in a false positive rate of over 45%, even if the Type-I error rate is set at 5%. While summarizing data across non-independent points (or lower levels) can potentially fix this problem, this approach greatly reduces the statistical power of the analysis. The hierarchical bootstrap, when applied sequentially over the levels of the hierarchical structure, keeps the Type-I error rate within the intended bound and retains more statistical power than summarizing methods. We conclude by demonstrating the effectiveness of the method in two real-world examples, first analyzing singing data in male Bengalese finches (Lonchura striata var. domestica) and second quantifying changes in behavior under optogenetic control in flies (Drosophila melanogaster).

Dopamine Depletion Affects Vocal Acoustics and Disrupts Sensorimotor Adaptation in Songbirds.

Dopamine is hypothesized to convey error information in reinforcement learning tasks with explicit appetitive or aversive cues. However, during motor skill learning feedback signals arise from an animal's evaluation of sensory feedback resulting from its own behavior, rather than any external reward or punishment. It has previously been shown that intact dopaminergic signaling from the ventral tegmental area/substantia nigra pars compacta (VTA/SNc) complex is necessary for vocal learning when songbirds modify their vocalizations to avoid hearing distorted auditory feedback (playbacks of white noise). However, it remains unclear whether dopaminergic signaling underlies vocal learning in response to more naturalistic errors (pitch-shifted feedback delivered via headphones). We used male Bengalese finches (Lonchura striata var. domestica) to test the hypothesis that the necessity of dopamine signaling is shared between the two types of learning. We combined 6-hydroxydopamine (6-OHDA) lesions of dopaminergic terminals within Area X, a basal ganglia nucleus critical for song learning, with a headphones learning paradigm that shifted the pitch of auditory feedback and compared their learning to that of unlesioned controls. We found that 6-OHDA lesions affected song behavior in two ways. First, over a period of days lesioned birds systematically lowered their pitch regardless of the presence or absence of auditory errors. Second, 6-OHDA lesioned birds also displayed severe deficits in sensorimotor learning in response to pitch-shifted feedback. Our results suggest roles for dopamine in both motor production and auditory error processing, and a shared mechanism underlying vocal learning in response to both distorted and pitch-shifted auditory feedback.

Neural Evolution of Context-Dependent Fly Song.

It is unclear where in the nervous system evolutionary changes tend to occur. To localize the source of neural evolution that has generated divergent behaviors, we developed a new approach to label and functionally manipulate homologous neurons across Drosophila species. We examined homologous descending neurons that drive courtship song in two species that sing divergent song types and localized relevant evolutionary changes in circuit function downstream of the intrinsic physiology of these descending neurons. This evolutionary change causes different species to produce divergent motor patterns in similar social contexts. Artificial stimulation of these descending neurons drives multiple song types, suggesting that multifunctional properties of song circuits may facilitate rapid evolution of song types.

How to Build a Behavior.

How are complicated behavioral sequences executed? In this issue of Neuron, Duistermars et al. (2018) deconstruct neural control schemes underlying threats in flies, finding a small collection of neurons in which varying levels of activation lead to the performance of different movements.

Optogenetic dissection of descending behavioral control in Drosophila.

In most animals, the brain makes behavioral decisions that are transmitted by descending neurons to the nerve cord circuitry that produces behaviors. In insects, only a few descending neurons have been associated with specific behaviors. To explore how descending neurons control an insect's movements, we developed a novel method to systematically assay the behavioral effects of activating individual neurons on freely behaving terrestrial D. melanogaster. We calculated a two-dimensional representation of the entire behavior space explored by these flies, and we associated descending neurons with specific behaviors by identifying regions of this space that were visited with increased frequency during optogenetic activation. Applying this approach across a large collection of descending neurons, we found that (1) activation of most of the descending neurons drove stereotyped behaviors, (2) in many cases multiple descending neurons activated similar behaviors, and (3) optogenetically activated behaviors were often dependent on the behavioral state prior to activation.

Measuring behavior across scales.

The need for high-throughput, precise, and meaningful methods for measuring behavior has been amplified by our recent successes in measuring and manipulating neural circuitry. The largest challenges associated with moving in this direction, however, are not technical but are instead conceptual: what numbers should one put on the movements an animal is performing (or not performing)? In this review, I will describe how theoretical and data analytical ideas are interfacing with recently-developed computational and experimental methodologies to answer these questions across a variety of contexts, length scales, and time scales. I will attempt to highlight commonalities between approaches and areas where further advances are necessary to place behavior on the same quantitative footing as other scientific fields.

Instantaneous brain dynamics mapped to a continuous state space.

Measures of whole-brain activity, from techniques such as functional Magnetic Resonance Imaging, provide a means to observe the brain's dynamical operations. However, interpretation of whole-brain dynamics has been stymied by the inherently high-dimensional structure of brain activity. The present research addresses this challenge through a series of scale transformations in the spectral, spatial, and relational domains. Instantaneous multispectral dynamics are first developed from input data via a wavelet filter bank. Voxel-level signals are then projected onto a representative set of spatially independent components. The correlation distance over the instantaneous wavelet-ICA state vectors is a graph that may be embedded onto a lower-dimensional space to assist the interpretation of state-space dynamics. Applying this procedure to a large sample of resting-state and task-active data (acquired through the Human Connectome Project), we segment the empirical state space into a continuum of stimulus-dependent brain states. Upon observing the local neighborhood of brain-states adopted subsequent to each stimulus, we may conclude that resting brain activity includes brain states that are, at times, similar to those adopted during tasks, but that are at other times distinct from task-active brain states. As task-active brain states often populate a local neighborhood, back-projection of segments of the dynamical state space onto the brain's surface reveals the patterns of brain activity that support many experimentally-defined states.

An unsupervised method for quantifying the behavior of paired animals.

Behaviors involving the interaction of multiple individuals are complex and frequently crucial for an animal's survival. These interactions, ranging across sensory modalities, length scales, and time scales, are often subtle and difficult to characterize. Contextual effects on the frequency of behaviors become even more difficult to quantify when physical interaction between animals interferes with conventional data analysis, e.g. due to visual occlusion. We introduce a method for quantifying behavior in fruit fly interaction that combines high-throughput video acquisition and tracking of individuals with recent unsupervised methods for capturing an animal's entire behavioral repertoire. We find behavioral differences between solitary flies and those paired with an individual of the opposite sex, identifying specific behaviors that are affected by social and spatial context. Our pipeline allows for a comprehensive description of the interaction between two individuals using unsupervised machine learning methods, and will be used to answer questions about the depth of complexity and variance in fruit fly courtship.

Cilia-mediated Hedgehog signaling controls form and function in the mammalian larynx.

Acoustic communication is fundamental to social interactions among animals, including humans. In fact, deficits in voice impair the quality of life for a large and diverse population of patients. Understanding the molecular genetic mechanisms of development and function in the vocal apparatus is thus an important challenge with relevance both to the basic biology of animal communication and to biomedicine. However, surprisingly little is known about the developmental biology of the mammalian larynx. Here, we used genetic fate mapping to chart the embryological origins of the tissues in the mouse larynx, and we describe the developmental etiology of laryngeal defects in mice with disruptions in cilia-mediated Hedgehog signaling. In addition, we show that mild laryngeal defects correlate with changes in the acoustic structure of vocalizations. Together, these data provide key new insights into the molecular genetics of form and function in the mammalian vocal apparatus.

Predictability and hierarchy in Drosophila behavior.

Even the simplest of animals exhibit behavioral sequences with complex temporal dynamics. Prominent among the proposed organizing principles for these dynamics has been the idea of a hierarchy, wherein the movements an animal makes can be understood as a set of nested subclusters. Although this type of organization holds potential advantages in terms of motion control and neural circuitry, measurements demonstrating this for an animal's entire behavioral repertoire have been limited in scope and temporal complexity. Here, we use a recently developed unsupervised technique to discover and track the occurrence of all stereotyped behaviors performed by fruit flies moving in a shallow arena. Calculating the optimally predictive representation of the fly's future behaviors, we show that fly behavior exhibits multiple time scales and is organized into a hierarchical structure that is indicative of its underlying behavioral programs and its changing internal states.