RESUMEN
As acquiring bigger data becomes easier in experimental brain science, computational and statistical brain science must achieve similar advances to fully capitalize on these data. Tackling these problems will benefit from a more explicit and concerted effort to work together. Specifically, brain science can be further democratized by harnessing the power of community-driven tools, which both are built by and benefit from many different people with different backgrounds and expertise. This perspective can be applied across modalities and scales and enables collaborations across previously siloed communities.
Asunto(s)
Macrodatos , Encéfalo/fisiología , Biología Computacional , Red Nerviosa/fisiología , Animales , Biología Computacional/métodos , Bases de Datos Genéticas , Expresión Génica/fisiología , HumanosRESUMEN
Keypoint tracking algorithms can flexibly quantify animal movement from videos obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into discrete actions. This challenge is particularly acute because keypoint data are susceptible to high-frequency jitter that clustering algorithms can mistake for transitions between actions. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules ('syllables') from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to identify syllables whose boundaries correspond to natural sub-second discontinuities in pose dynamics. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq also works in multiple species and generalizes beyond the syllable timescale, identifying fast sniff-aligned movements in mice and a spectrum of oscillatory behaviors in fruit flies. Keypoint-MoSeq, therefore, renders accessible the modular structure of behavior through standard video recordings.
Asunto(s)
Algoritmos , Conducta Animal , Aprendizaje Automático , Grabación en Video , Animales , Ratones , Conducta Animal/fisiología , Grabación en Video/métodos , Movimiento/fisiología , Drosophila melanogaster/fisiología , Humanos , MasculinoRESUMEN
The desire to understand how the brain generates and patterns behavior has driven rapid methodological innovation in tools to quantify natural animal behavior. While advances in deep learning and computer vision have enabled markerless pose estimation in individual animals, extending these to multiple animals presents unique challenges for studies of social behaviors or animals in their natural environments. Here we present Social LEAP Estimates Animal Poses (SLEAP), a machine learning system for multi-animal pose tracking. This system enables versatile workflows for data labeling, model training and inference on previously unseen data. SLEAP features an accessible graphical user interface, a standardized data model, a reproducible configuration system, over 30 model architectures, two approaches to part grouping and two approaches to identity tracking. We applied SLEAP to seven datasets across flies, bees, mice and gerbils to systematically evaluate each approach and architecture, and we compare it with other existing approaches. SLEAP achieves greater accuracy and speeds of more than 800 frames per second, with latencies of less than 3.5 ms at full 1,024 × 1,024 image resolution. This makes SLEAP usable for real-time applications, which we demonstrate by controlling the behavior of one animal on the basis of the tracking and detection of social interactions with another animal.
Asunto(s)
Aprendizaje Profundo , Algoritmos , Animales , Conducta Animal , Cabeza , Aprendizaje Automático , Ratones , Conducta SocialRESUMEN
The need for automated and efficient systems for tracking full animal pose has increased with the complexity of behavioral data and analyses. Here we introduce LEAP (LEAP estimates animal pose), a deep-learning-based method for predicting the positions of animal body parts. This framework consists of a graphical interface for labeling of body parts and training the network. LEAP offers fast prediction on new data, and training with as few as 100 frames results in 95% of peak performance. We validated LEAP using videos of freely behaving fruit flies and tracked 32 distinct points to describe the pose of the head, body, wings and legs, with an error rate of <3% of body length. We recapitulated reported findings on insect gait dynamics and demonstrated LEAP's applicability for unsupervised behavioral classification. Finally, we extended the method to more challenging imaging situations and videos of freely moving mice.
Asunto(s)
Conducta Animal , Aprendizaje Profundo , Drosophila melanogaster/fisiología , Redes Neurales de la Computación , Reconocimiento de Normas Patrones Automatizadas/métodos , Algoritmos , Animales , Automatización , Gráficos por Computador , Marcha , Locomoción , Masculino , Ratones , Interfaz Usuario-ComputadorRESUMEN
How do social factors impact the brain and contribute to increased alcohol drinking? We found that social rank predicts alcohol drinking, where subordinates drink more than dominants. Furthermore, social isolation escalates alcohol drinking, particularly impacting subordinates who display a greater increase in alcohol drinking compared to dominants. Using cellular resolution calcium imaging, we show that the basolateral amygdala-medial prefrontal cortex (BLA-mPFC) circuit predicts alcohol drinking in a rank-dependent manner, unlike non-specific BLA activity. The BLA-mPFC circuit becomes hyperexcitable during social isolation, detecting social isolation states. Mimicking the observed increases in BLA-mPFC activity using optogenetics was sufficient to increase alcohol drinking, suggesting the BLA-mPFC circuit may be a neural substrate for the negative impact of social isolation. To test the hypothesis that the BLA-mPFC circuit conveys a signal induced by social isolation to motivate alcohol consumption, we first determined if this circuit detects social information. Leveraging optogenetics in combination with calcium imaging and computer vision pose tracking, we found that BLA-mPFC circuitry governs social behavior and neural representation of social contact. We further show that BLA-mPFC stimulation mimics social isolation-induced mPFC encoding of sucrose and alcohol, and inhibition of the BLA-mPFC circuit decreases alcohol drinking following social isolation. Collectively, these data suggest the amygdala-cortical circuit mirrors a neural encoding state similar to social isolation and underlies social isolation-associated alcohol drinking.
RESUMEN
Image segmentation is commonly used to estimate the location and shape of plants and their external structures. Segmentation masks are then used to localize landmarks of interest and compute other geometric features that correspond to the plant's phenotype. Despite its prevalence, segmentation-based approaches are laborious (requiring extensive annotation to train) and error-prone (derived geometric features are sensitive to instance mask integrity). Here, we present a segmentation-free approach that leverages deep learning-based landmark detection and grouping, also known as pose estimation. We use a tool originally developed for animal motion capture called SLEAP (Social LEAP Estimates Animal Poses) to automate the detection of distinct morphological landmarks on plant roots. Using a gel cylinder imaging system across multiple species, we show that our approach can reliably and efficiently recover root system topology at high accuracy, few annotated samples, and faster speed than segmentation-based approaches. In order to make use of this landmark-based representation for root phenotyping, we developed a Python library (sleap-roots) for trait extraction directly comparable to existing segmentation-based analysis software. We show that pose-derived root traits are highly accurate and can be used for common downstream tasks including genotype classification and unsupervised trait mapping. Altogether, this work establishes the validity and advantages of pose estimation-based plant phenotyping. To facilitate adoption of this easy-to-use tool and to encourage further development, we make sleap-roots, all training data, models, and trait extraction code available at: https://github.com/talmolab/sleap-roots and https://osf.io/k7j9g/.
RESUMEN
Recently developed methods for video analysis, especially models for pose estimation and behavior classification, are transforming behavioral quantification to be more precise, scalable, and reproducible in fields such as neuroscience and ethology. These tools overcome long-standing limitations of manual scoring of video frames and traditional 'center of mass' tracking algorithms to enable video analysis at scale. The expansion of open-source tools for video acquisition and analysis has led to new experimental approaches to understand behavior. Here, we review currently available open-source tools for video analysis and discuss how to set up these methods for labs new to video recording. We also discuss best practices for developing and using video analysis methods, including community-wide standards and critical needs for the open sharing of datasets and code, more widespread comparisons of video analysis methods, and better documentation for these methods especially for new users. We encourage broader adoption and continued development of these tools, which have tremendous potential for accelerating scientific progress in understanding the brain and behavior.
Asunto(s)
Algoritmos , Programas Informáticos , Animales , Conducta Animal , Etología , Grabación en VideoRESUMEN
Keypoint tracking algorithms have revolutionized the analysis of animal behavior, enabling investigators to flexibly quantify behavioral dynamics from conventional video recordings obtained in a wide variety of settings. However, it remains unclear how to parse continuous keypoint data into the modules out of which behavior is organized. This challenge is particularly acute because keypoint data is susceptible to high frequency jitter that clustering algorithms can mistake for transitions between behavioral modules. Here we present keypoint-MoSeq, a machine learning-based platform for identifying behavioral modules ("syllables") from keypoint data without human supervision. Keypoint-MoSeq uses a generative model to distinguish keypoint noise from behavior, enabling it to effectively identify syllables whose boundaries correspond to natural sub-second discontinuities inherent to mouse behavior. Keypoint-MoSeq outperforms commonly used alternative clustering methods at identifying these transitions, at capturing correlations between neural activity and behavior, and at classifying either solitary or social behaviors in accordance with human annotations. Keypoint-MoSeq therefore renders behavioral syllables and grammar accessible to the many researchers who use standard video to capture animal behavior.
RESUMEN
Image segmentation is commonly used to estimate the location and shape of plants and their external structures. Segmentation masks are then used to localize landmarks of interest and compute other geometric features that correspond to the plant's phenotype. Despite its prevalence, segmentation-based approaches are laborious (requiring extensive annotation to train), and error-prone (derived geometric features are sensitive to instance mask integrity). Here we present a segmentation-free approach which leverages deep learning-based landmark detection and grouping, also known as pose estimation. We use a tool originally developed for animal motion capture called SLEAP (Social LEAP Estimates Animal Poses) to automate the detection of distinct morphological landmarks on plant roots. Using a gel cylinder imaging system across multiple species, we show that our approach can reliably and efficiently recover root system topology at high accuracy, few annotated samples, and faster speed than segmentation-based approaches. In order to make use of this landmark-based representation for root phenotyping, we developed a Python library (sleap-roots) for trait extraction directly comparable to existing segmentation-based analysis software. We show that landmark-derived root traits are highly accurate and can be used for common downstream tasks including genotype classification and unsupervised trait mapping. Altogether, this work establishes the validity and advantages of pose estimation-based plant phenotyping. To facilitate adoption of this easy-to-use tool and to encourage further development, we make sleap-roots, all training data, models, and trait extraction code available at: https://github.com/talmolab/sleap-roots and https://osf.io/k7j9g/.
RESUMEN
BACKGROUND: In recent years, there has been an increase of interest in plant behaviour as represented by growth-driven responses. These are generally classified into nastic (internally driven) and tropic (environmentally driven) movements. Nastic movements include circumnutations, a circular movement of plant organs commonly associated with search and exploration, while tropisms refer to the directed growth of plant organs toward or away from environmental stimuli, such as light and gravity. Tracking these movements is therefore fundamental for the study of plant behaviour. Convolutional neural networks, as used for human and animal pose estimation, offer an interesting avenue for plant tracking. Here we adopted the Social LEAP Estimates Animal Poses (SLEAP) framework for plant tracking. We evaluated it on time-lapse videos of cases spanning a variety of parameters, such as: (i) organ types and imaging angles (e.g., top-view crown leaves vs. side-view shoots and roots), (ii) lighting conditions (full spectrum vs. IR), (iii) plant morphologies and scales (100 µm-scale Arabidopsis seedlings vs. cm-scale sunflowers and beans), and (iv) movement types (circumnutations, tropisms and twining). RESULTS: Overall, we found SLEAP to be accurate in tracking side views of shoots and roots, requiring only a low number of user-labelled frames for training. Top views of plant crowns made up of multiple leaves were found to be more challenging, due to the changing 2D morphology of leaves, and the occlusions of overlapping leaves. This required a larger number of labelled frames, and the choice of labelling "skeleton" had great impact on prediction accuracy, i.e., a more complex skeleton with fewer individuals (tracking individual plants) provided better results than a simpler skeleton with more individuals (tracking individual leaves). CONCLUSIONS: In all, these results suggest SLEAP is a robust and versatile tool for high-throughput automated tracking of plants, presenting a new avenue for research focusing on plant dynamics.
RESUMEN
Social isolation, particularly in early life, leads to deleterious physiological and behavioral outcomes. Here, we leverage new high-throughput tools to comprehensively investigate the impact of isolation in the bumblebee, Bombus impatiens, from behavioral, molecular, and neuroanatomical perspectives. We reared newly emerged bumblebees in complete isolation, in small groups, or in their natal colony, and then analyzed their behaviors while alone or paired with another bee. We find that when alone, individuals of each rearing condition show distinct behavioral signatures. When paired with a conspecific, bees reared in small groups or in the natal colony express similar behavioral profiles. Isolated bees, however, showed increased social interactions. To identify the neurobiological correlates of these differences, we quantified brain gene expression and measured the volumes of key brain regions for a subset of individuals from each rearing condition. Overall, we find that isolation increases social interactions and disrupts gene expression and brain development. Limited social experience in small groups is sufficient to preserve typical patterns of brain development and social behavior.
Asunto(s)
Conducta Social , Interacción Social , Animales , Abejas , Encéfalo , Aislamiento SocialRESUMEN
Over the past years, numerous methods have emerged to automate the quantification of animal behavior at a resolution not previously imaginable. This has opened up a new field of computational ethology and will, in the near future, make it possible to quantify in near completeness what an animal is doing as it navigates its environment. The importance of improving the techniques with which we characterize behavior is reflected in the emerging recognition that understanding behavior is an essential (or even prerequisite) step to pursuing neuroscience questions. The use of these methods, however, is not limited to studying behavior in the wild or in strictly ethological settings. Modern tools for behavioral quantification can be applied to the full gamut of approaches that have historically been used to link brain to behavior, from psychophysics to cognitive tasks, augmenting those measurements with rich descriptions of how animals navigate those tasks. Here we review recent technical advances in quantifying behavior, particularly in methods for tracking animal motion and characterizing the structure of those dynamics. We discuss open challenges that remain for behavioral quantification and highlight promising future directions, with a strong emphasis on emerging approaches in deep learning, the core technology that has enabled the markedly rapid pace of progress of this field. We then discuss how quantitative descriptions of behavior can be leveraged to connect brain activity with animal movements, with the ultimate goal of resolving the relationship between neural circuits, cognitive processes and behavior.
Asunto(s)
Conducta Animal/fisiología , Conducta/fisiología , Encéfalo/fisiología , Animales , Humanos , NeurocienciasRESUMEN
Objective and automatic measurement of pain in mice remains a barrier for discovery in neuroscience. Here, we capture paw kinematics during pain behavior in mice with high-speed videography and automated paw tracking with machine and deep learning approaches. Our statistical software platform, PAWS (Pain Assessment at Withdrawal Speeds), uses a univariate projection of paw position over time to automatically quantify seven behavioral features that are combined into a single, univariate pain score. Automated paw tracking combined with PAWS reveals a behaviorally divergent mouse strain that displays hypersensitivity to mechanical stimuli. To demonstrate the efficacy of PAWS for detecting spinally versus centrally mediated behavioral responses, we chemogenetically activated nociceptive neurons in the amygdala, which further separated the pain-related behavioral features and the resulting pain score. Taken together, this automated pain quantification approach will increase objectivity in collecting rigorous behavioral data, and it is compatible with other neural circuit dissection tools for determining the mouse pain state.
Asunto(s)
Automatización de Laboratorios/instrumentación , Dimensión del Dolor/métodos , Animales , Femenino , Masculino , Ratones , Factores de TiempoRESUMEN
Sustained changes in mood or action require persistent changes in neural activity, but it has been difficult to identify the neural circuit mechanisms that underlie persistent activity and contribute to long-lasting changes in behavior. Here, we show that a subset of Doublesex+ pC1 neurons in the Drosophila female brain, called pC1d/e, can drive minutes-long changes in female behavior in the presence of males. Using automated reconstruction of a volume electron microscopic (EM) image of the female brain, we map all inputs and outputs to both pC1d and pC1e. This reveals strong recurrent connectivity between, in particular, pC1d/e neurons and a specific subset of Fruitless+ neurons called aIPg. We additionally find that pC1d/e activation drives long-lasting persistent neural activity in brain areas and cells overlapping with the pC1d/e neural network, including both Doublesex+ and Fruitless+ neurons. Our work thus links minutes-long persistent changes in behavior with persistent neural activity and recurrent circuit architecture in the female brain.
Long-term mental states such as arousal and mood variations rely on persistent changes in the activity of certain neural circuits which have been difficult to identify. For instance, in male fruit flies, the activation of a particular circuit containing 'P1 neurons' can escalate aggressive and mating behaviors. However, less is known about the neural networks that underlie arousal in female flies. A group of female-specific, 'pC1 neurons' similar to P1 neurons could play this role, but it was unclear whether it could drive lasting changes in female fly behavior. To investigate this question, Deutsch et al. stimulated or shut down pC1 circuits in female flies, and then recorded the insects' interactions with male flies. Stimulation was accomplished using optogenetics, a technique which allows researchers to precisely control the activity of specially modified light-sensitive neurons. Silencing pC1 neurons in female flies diminished their interest in male partners and their suitor's courtship songs. Activating these neural circuits made the females more receptive to males; it also triggered long-lasting aggressive behaviors not typically observed in virgin females, such as shoving and chasing. Deutsch et al. then identified the brain cells that pC1 neurons connect to, discovering that these neurons are part of an interconnected circuit also formed of aIPg neurons a population of fly brain cells that shows sex differences and is linked to female aggression. The brains of females were then imaged as pC1 neurons were switched on, revealing a persistent activity which outlasted the activation in circuits containing both pC1 and aIPg neurons. Thus, these results link neural circuit architecture to long lasting changes in neural activity, and ultimately, in behavior. Future experiments can build on these results to determine how this circuit is activated during natural social interactions.
Asunto(s)
Encéfalo/fisiología , Drosophila melanogaster/fisiología , Vías Nerviosas/fisiología , Neuronas/fisiología , Animales , Encéfalo/ultraestructura , Cortejo , Drosophila melanogaster/ultraestructura , Femenino , Masculino , Microscopía Electrónica , Actividad Motora/fisiología , Vías Nerviosas/ultraestructuraRESUMEN
Deciphering how brains generate behavior depends critically on an accurate description of behavior. If distinct behaviors are lumped together, separate modes of brain activity can be wrongly attributed to the same behavior. Alternatively, if a single behavior is split into two, the same neural activity can appear to produce different behaviors. Here, we address this issue in the context of acoustic communication in Drosophila. During courtship, males vibrate their wings to generate time-varying songs, and females evaluate songs to inform mating decisions. For 50 years, Drosophila melanogaster song was thought to consist of only two modes, sine and pulse, but using unsupervised classification methods on large datasets of song recordings, we now establish the existence of at least three song modes: two distinct pulse types, along with a single sine mode. We show how this seemingly subtle distinction affects our interpretation of the mechanisms underlying song production and perception. Specifically, we show that visual feedback influences the probability of producing each song mode and that male song mode choice affects female responses and contributes to modulating his song amplitude with distance. At the neural level, we demonstrate how the activity of four separate neuron types within the fly's song pathway differentially affects the probability of producing each song mode. Our results highlight the importance of carefully segmenting behavior to map the underlying sensory, neural, and genetic mechanisms.
Asunto(s)
Comunicación Animal , Drosophila melanogaster/fisiología , Neuronas Motoras/fisiología , Conducta Sexual Animal/fisiología , Animales , CortejoRESUMEN
Cognitive and social capacities require postnatal experience, yet the pathways by which experience guides development are unknown. Here we show that the normal development of motor and nonmotor capacities requires cerebellar activity. Using chemogenetic perturbation of molecular layer interneurons to attenuate cerebellar output in mice, we found that activity of posterior regions in juvenile life modulates adult expression of eyeblink conditioning (paravermal lobule VI, crus I), reversal learning (lobule VI), persistive behavior and novelty-seeking (lobule VII), and social preference (crus I/II). Perturbation in adult life altered only a subset of phenotypes. Both adult and juvenile disruption left gait metrics largely unaffected. Contributions to phenotypes increased with the amount of lobule inactivated. Using an anterograde transsynaptic tracer, we found that posterior cerebellum made strong connections with prelimbic, orbitofrontal, and anterior cingulate cortex. These findings provide anatomical substrates for the clinical observation that cerebellar injury increases the risk of autism.
Asunto(s)
Trastorno Autístico/fisiopatología , Conducta Animal/fisiología , Cerebelo/fisiología , Cognición/fisiología , Animales , Mapeo Encefálico , Cerebelo/diagnóstico por imagen , Modelos Animales de Enfermedad , Humanos , Procesamiento de Imagen Asistido por Computador , Interneuronas/fisiología , Aprendizaje/fisiología , Imagen por Resonancia Magnética , Ratones , Vías Nerviosas/fisiología , Cambio SocialRESUMEN
In this issue of Neuron, Watanabe et al. (2017) uncover how octopamine, an invertebrate norepinephrine analog, modulates the neural pathways that bias Drosophila males toward aggression.
Asunto(s)
Drosophila , Octopamina , Agresión , Animales , Proteínas de Drosophila , Masculino , NeuronasRESUMEN
Cerebellar granule cells, which constitute half the brain's neurons, supply Purkinje cells with contextual information necessary for motor learning, but how they encode this information is unknown. Here we show, using two-photon microscopy to track neural activity over multiple days of cerebellum-dependent eyeblink conditioning in mice, that granule cell populations acquire a dense representation of the anticipatory eyelid movement. Initially, granule cells responded to neutral visual and somatosensory stimuli as well as periorbital airpuffs used for training. As learning progressed, two-thirds of monitored granule cells acquired a conditional response whose timing matched or preceded the learned eyelid movements. Granule cell activity covaried trial by trial to form a redundant code. Many granule cells were also active during movements of nearby body structures. Thus, a predictive signal about the upcoming movement is widely available at the input stage of the cerebellar cortex, as required by forward models of cerebellar control.
Asunto(s)
Cerebelo/fisiología , Retroalimentación , Aprendizaje/fisiología , Neuronas/fisiología , Animales , Anticipación Psicológica/fisiología , Condicionamiento Clásico/fisiología , Masculino , Ratones , Ratones TransgénicosRESUMEN
BACKGROUND: Metagenomics enables the analysis of bacterial population composition and the study of emergent population features, such as shared metabolic pathways. Recently, we have shown that metagenomics datasets can be leveraged to characterize population-wide transcriptional regulatory networks, or meta-regulons, providing insights into how bacterial populations respond collectively to specific triggers. Here we formalize a Bayesian inference framework to analyze the composition of transcriptional regulatory networks in metagenomes by determining the probability of regulation of orthologous gene sequences. We assess the performance of this approach on synthetic datasets and we validate it by analyzing the copper-homeostasis network of Firmicutes species in the human gut microbiome. RESULTS: Assessment on synthetic datasets shows that our method provides a robust and interpretable metric for assessing putative regulation by a transcription factor on sets of promoter sequences mapping to an orthologous gene cluster. The inference framework integrates the regulatory contribution of secondary sites and can discern false positives arising from multiple instances of a clonal sequence. Posterior probabilities for orthologous gene clusters decline sharply when less than 20 % of mapped promoters have binding sites, but we introduce a sensitivity adjustment procedure to speed up computation that enhances regulation assessment in heterogeneous ortholog clusters. Analysis of the copper-homeostasis regulon governed by CsoR in the human gut microbiome Firmicutes reveals that CsoR controls itself and copper-translocating P-type ATPases, but not CopZ-type copper chaperones. Our analysis also indicates that CsoR frequently targets promoters with dual CsoR-binding sites, suggesting that it exploits higher-order binding conformations to fine-tune its activity. CONCLUSIONS: We introduce and validate a method for the analysis of transcriptional regulatory networks from metagenomic data that enables inference of meta-regulons in a systematic and interpretable way. Validation of this method on the CsoR meta-regulon of gut microbiome Firmicutes illustrates the usefulness of the approach, revealing novel properties of the copper-homeostasis network in poorly characterized bacterial species and putting forward evidence of new mechanisms of DNA binding for this transcriptional regulator. Our approach will enable the comparative analysis of regulatory networks across metagenomes, yielding novel insights into the evolution of transcriptional regulatory networks.