Ethological computational psychiatry: Challenges and opportunities.

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.

Studying dominance and aggression requires ethologically relevant paradigms.

Although aggression is associated with several psychiatric disorders, there is no effective treatment nor a rigorous definition for "pathological aggression". Mice make a valuable model for studying aggression. They have a dynamic social structure that depends on the habitat and includes reciprocal interactions between the mice's aggression levels, social dominance hierarchy (SDH), and resource allocation. Nevertheless, the classical behavioral tests for territorial aggression and SDH in mice are reductive and have limited ethological and translational relevance. Recent work has explored the use of semi-natural environments to simultaneously study dominance-related behaviors, resource allocation, and aggressive behavior. Semi-natural setups allow experimental control of the environment combined with manipulations of neural activity. We argue that these setups can help bridge the translational gap in aggression research toward discovering neuronal mechanisms underlying maladaptive aggression.

Beyond simple laboratory studies: Developing sophisticated models to study rich behavior.

Psychology and neuroscience are concerned with the study of behavior, of internal cognitive processes, and their neural foundations. However, most laboratory studies use constrained experimental settings that greatly limit the range of behaviors that can be expressed. While focusing on restricted settings ensures methodological control, it risks impoverishing the object of study: by restricting behavior, we might miss key aspects of cognitive and neural functions. In this article, we argue that psychology and neuroscience should increasingly adopt innovative experimental designs, measurement methods, analysis techniques and sophisticated computational models to probe rich, ecologically valid forms of behavior, including social behavior. We discuss the challenges of studying rich forms of behavior as well as the novel opportunities offered by state-of-the-art methodologies and new sensing technologies, and we highlight the importance of developing sophisticated formal models. We exemplify our arguments by reviewing some recent streams of research in psychology, neuroscience and other fields (e.g., sports analytics, ethology and robotics) that have addressed rich forms of behavior in a model-based manner. We hope that these "success cases" will encourage psychologists and neuroscientists to extend their toolbox of techniques with sophisticated behavioral models - and to use them to study rich forms of behavior as well as the cognitive and neural processes that they engage.

Advancing social behavioral neuroscience by integrating ethology and comparative psychology methods through machine learning.

Social behavior is naturally occurring in vertebrate species, which holds a strong evolutionary component and is crucial for the normal development and survival of individuals throughout life. Behavioral neuroscience has seen different influential methods for social behavioral phenotyping. The ethological research approach has extensively investigated social behavior in natural habitats, while the comparative psychology approach was developed utilizing standardized and univariate social behavioral tests. The development of advanced and precise tracking tools, together with post-tracking analysis packages, has recently enabled a novel behavioral phenotyping method, that includes the strengths of both approaches. The implementation of such methods will be beneficial for fundamental social behavioral research but will also enable an increased understanding of the influences of many different factors that can influence social behavior, such as stress exposure. Furthermore, future research will increase the number of data modalities, such as sensory, physiological, and neuronal activity data, and will thereby significantly enhance our understanding of the biological basis of social behavior and guide intervention strategies for behavioral abnormalities in psychiatric disorders.

Connecting the dots in ethology: applying network theory to understand neural and animal collectives.

A major goal shared by neuroscience and collective behavior is to understand how dynamic interactions between individual elements give rise to behaviors in populations of neurons and animals, respectively. This goal has recently become within reach, thanks to techniques providing access to the connectivity and activity of neuronal ensembles as well as to behaviors among animal collectives. The next challenge using these datasets is to unravel network mechanisms generating population behaviors. This is aided by network theory, a field that studies structure-function relationships in interconnected systems. Here we review studies that have taken a network view on modern datasets to provide unique insights into individual and collective animal behaviors. Specifically, we focus on how analyzing signal propagation, controllability, symmetry, and geometry of networks can tame the complexity of collective system dynamics. These studies illustrate the potential of network theory to accelerate our understanding of behavior across ethological scales.

Fast and accurate annotation of acoustic signals with deep neural networks.

Acoustic signals serve communication within and across species throughout the animal kingdom. Studying the genetics, evolution, and neurobiology of acoustic communication requires annotating acoustic signals: segmenting and identifying individual acoustic elements like syllables or sound pulses. To be useful, annotations need to be accurate, robust to noise, and fast.We here introduce DeepAudioSegmenter (DAS), a method that annotates acoustic signals across species based on a deep-learning derived hierarchical presentation of sound. We demonstrate the accuracy, robustness, and speed of DAS using acoustic signals with diverse characteristics from insects, birds, and mammals. DAS comes with a graphical user interface for annotating song, training the network, and for generating and proofreading annotations. The method can be trained to annotate signals from new species with little manual annotation and can be combined with unsupervised methods to discover novel signal types. DAS annotates song with high throughput and low latency for experimental interventions in realtime. Overall, DAS is a universal, versatile, and accessible tool for annotating acoustic communication signals.

Visual pursuit behavior in mice maintains the pursued prey on the retinal region with least optic flow.

Mice have a large visual field that is constantly stabilized by vestibular ocular reflex (VOR) driven eye rotations that counter head-rotations. While maintaining their extensive visual coverage is advantageous for predator detection, mice also track and capture prey using vision. However, in the freely moving animal quantifying object location in the field of view is challenging. Here, we developed a method to digitally reconstruct and quantify the visual scene of freely moving mice performing a visually based prey capture task. By isolating the visual sense and combining a mouse eye optic model with the head and eye rotations, the detailed reconstruction of the digital environment and retinal features were projected onto the corneal surface for comparison, and updated throughout the behavior. By quantifying the spatial location of objects in the visual scene and their motion throughout the behavior, we show that the prey image consistently falls within a small area of the VOR-stabilized visual field. This functional focus coincides with the region of minimal optic flow within the visual field and consequently area of minimal motion-induced image-blur, as during pursuit mice ran directly toward the prey. The functional focus lies in the upper-temporal part of the retina and coincides with the reported high density-region of Alpha-ON sustained retinal ganglion cells.

Mice have a lot to keep an eye on. To survive, they need to dodge predators looming on land and from the skies, while also hunting down the small insects that are part of their diet. To do this, they are helped by their large panoramic field of vision, which stretches from behind and over their heads to below their snouts. To stabilize their gaze when they are on the prowl, mice reflexively move their eyes to counter the movement of their head: in fact, they are unable to move their eyes independently. This raises the question: what part of their large visual field of view do these rodents use when tracking a prey, and to what advantage? This is difficult to investigate, since it requires simultaneously measuring the eye and head movements of mice as they chase and capture insects. In response, Holmgren, Stahr et al. developed a new technique to record the precise eye positions, head rotations and prey location of mice hunting crickets in surroundings that were fully digitized at high resolution. Combining this information allowed the team to mathematically recreate what mice would see as they chased the insects, and to assess what part of their large visual field they were using. This revealed that, once a cricket had entered any part of the mice's large field of view, the rodents shifted their head ­ but not their eyes ­ to bring the prey into both eye views, and then ran directly at it. If the insect escaped, the mice repeated that behavior. During the pursuit, the cricket's position was mainly held in a small area of the mouse's view that corresponds to a specialized region in the eye which is thought to help track objects. This region also allowed the least motion-induced image blur when the animals were running forward. The approach developed by Holmgren, Stahr et al. gives a direct insight into what animals see when they hunt, and how this constantly changing view ties to what happens in the eyes. This method could be applied to other species, ushering in a new wave of tools to explore what freely moving animals see, and the relationship between behaviour and neural circuitry.

Rhythmic abilities in humans and non-human animals: a review and recommendations from a methodological perspective.

Rhythmic behaviour is ubiquitous in both human and non-human animals, but it is unclear whether the cognitive mechanisms underlying the specific rhythmic behaviours observed in different species are related. Laboratory experiments combined with highly controlled stimuli and tasks can be very effective in probing the cognitive architecture underlying rhythmic abilities. Rhythmic abilities have been examined in the laboratory with explicit and implicit perception tasks, and with production tasks, such as sensorimotor synchronization, with stimuli ranging from isochronous sequences of artificial sounds to human music. Here, we provide an overview of experimental findings on rhythmic abilities in human and non-human animals, while critically considering the wide variety of paradigms used. We identify several gaps in what is known about rhythmic abilities. Many bird species have been tested on rhythm perception, but research on rhythm production abilities in the same birds is lacking. By contrast, research in mammals has primarily focused on rhythm production rather than perception. Many experiments also do not differentiate between possible components of rhythmic abilities, such as processing of single temporal intervals, rhythmic patterns, a regular beat or hierarchical metrical structures. For future research, we suggest a careful choice of paradigm to aid cross-species comparisons, and a critical consideration of the multifaceted abilities that underlie rhythmic behaviour. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

An ecological approach to measuring synchronization abilities across the animal kingdom.

In this perspective paper, we focus on the study of synchronization abilities across the animal kingdom. We propose an ecological approach to studying nonhuman animal synchronization that begins from observations about when, how and why an animal might synchronize spontaneously with natural environmental rhythms. We discuss what we consider to be the most important, but thus far largely understudied, temporal, physical, perceptual and motivational constraints that must be taken into account when designing experiments to test synchronization in nonhuman animals. First and foremost, different species are likely to be sensitive to and therefore capable of synchronizing at different timescales. We also argue that it is fruitful to consider the latent flexibility of animal synchronization. Finally, we discuss the importance of an animal's motivational state for showcasing synchronization abilities. We demonstrate that the likelihood that an animal can successfully synchronize with an environmental rhythm is context-dependent and suggest that the list of species capable of synchronization is likely to grow when tested with ecologically honest, species-tuned experiments. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

Promises and challenges of human computational ethology.

The movements an organism makes provide insights into its internal states and motives. This principle is the foundation of the new field of computational ethology, which links rich automatic measurements of natural behaviors to motivational states and neural activity. Computational ethology has proven transformative for animal behavioral neuroscience. This success raises the question of whether rich automatic measurements of behavior can similarly drive progress in human neuroscience and psychology. New technologies for capturing and analyzing complex behaviors in real and virtual environments enable us to probe the human brain during naturalistic dynamic interactions with the environment that so far were beyond experimental investigation. Inspired by nonhuman computational ethology, we explore how these new tools can be used to test important questions in human neuroscience. We argue that application of this methodology will help human neuroscience and psychology extend limited behavioral measurements such as reaction time and accuracy, permit novel insights into how the human brain produces behavior, and ultimately reduce the growing measurement gap between human and animal neuroscience.

A Comparison of Focal and Opportunistic Sampling Methods when Studying Chimpanzee Facial and Gestural Communication.

Researchers frequently use focal individual sampling to study primate communication. Recent studies of primate gestures have shown that opportunistic sampling offers benefits not found in focal individual sampling, such as the collection of larger sample sizes. What is not known is whether the opportunistic method is biased towards certain signal types or signalers. Our goal was to assess the validity of the opportunistic method by comparing focal individual sampling to opportunistic sampling of facial and gestural communication in a group of captive chimpanzees (Pan troglodytes). We compared: (1) the number of observed facial and gestural signals per signal type and (2) the number of observed facial and gestural signals produced by each signaler. Both methods identified facial signals, gesture signals, and gesture signalers at similar relative rates, but the opportunistic sampling method yielded a more even distribution of signalers and signal types than the focal individual sampling method. In addition, the opportunistic sampling method resulted in larger sample sizes for both facial and gestural communication. However, the opportunistic method did not allow us to calculate the signals per time for each individual, which is easily done with the focal individual method. These results suggest that the opportunistic sampling method is (1) comparable to the focal individual sampling method in multiple important measures, (2) associated with additional sampling benefits, and (3) limited in measuring some variables. Thus, we recommend that future studies use a mixed-methods approach, as focal individual and opportunistic sampling have distinct strengths that complement each other's limitations.

A Visual Tracking System for Honey Bee (Hymenoptera: Apidae) 3D Flight Trajectory Reconstruction and Analysis.

We describe the development, field testing, and results from an automated 3D insect flight detection and tracking system for honey bees (Apis mellifera L.) (Hymenoptera: Apidae) that is capable of providing remarkable insights into airborne behavior. It comprises two orthogonally mounted video cameras with an observing volume of over 200 m3 and an offline analysis software system that outputs 3D space trajectories and inflight statistics of the target honey bees. The imaging devices require no human intervention once set up and are waterproof, providing high resolution and framerate videos. The software module uses several forms of modern image processing techniques with GPU-enabled acceleration to remove both stationary and moving artifact while preserving flight track information. The analysis system has thus far provided information not only on flight statistics (such as speeds and accelerations), but also on subtleties associated with flight behavior by generating heat maps of density and classifying flight patterns according to patrol and foraging behavior. Although the results presented here focus on behavior in the locale of a beehive, the system could be adapted to study a wide range of airborne insect activity.

Action detection using a neural network elucidates the genetics of mouse grooming behavior.

Automated detection of complex animal behaviors remains a challenging problem in neuroscience, particularly for behaviors that consist of disparate sequential motions. Grooming is a prototypical stereotyped behavior that is often used as an endophenotype in psychiatric genetics. Here, we used mouse grooming behavior as an example and developed a general purpose neural network architecture capable of dynamic action detection at human observer-level performance and operating across dozens of mouse strains with high visual diversity. We provide insights into the amount of human annotated training data that are needed to achieve such performance. We surveyed grooming behavior in the open field in 2457 mice across 62 strains, determined its heritable components, conducted GWAS to outline its genetic architecture, and performed PheWAS to link human psychiatric traits through shared underlying genetics. Our general machine learning solution that automatically classifies complex behaviors in large datasets will facilitate systematic studies of behavioral mechanisms.

Behavior is one of the ultimate and most complex outputs of the body's central nervous system, which controls movement, emotion and mood. It is also influenced by a person's genetics. Scientists studying the link between behavior and genetics often conduct experiments using animals, whose actions can be more easily characterized than humans. However, this involves recording hours of video footage, typically of mice or flies. Researchers must then add labels to this footage, identifying certain behaviors before further analysis. This task of annotating video clips ­ similar to image captioning ­ is very time-consuming for investigators. But it could be automated by applying machine learning algorithms, trained with sufficient data. Some computer programs are already in use to detect patterns of behavior, however, there are some limitations. These programs could detect animal behavior (of flies and mice) in trimmed video clips, but not raw footage, and could not always accommodate different lighting conditions or experimental setups. Here, Geuther et al. set out to improve on these previous efforts to automate video annotation. To do so, they used over 1,250 video clips annotated by experienced researchers to develop a general-purpose neural network for detecting mouse behaviors. After sufficient training, the computer model could detect mouse grooming behaviors in raw, untrimmed video clips just as well as human observers could. It also worked with mice of different coat colors, body shapes and sizes in open field animal tests. Using the new computer model, Geuther et al. also studied the genetics underpinning behavior ­ far more thoroughly than previously possible ­ to explain why mice display different grooming behaviors. The algorithm analyzed 2,250 hours of video featuring over 60 kinds of mice and thousands of other animals. It found that mice bred in the laboratory groom less than mice recently collected from the wild do. Further analyses also identified genes linked to grooming traits in mice and found related genes in humans associated with behavioral disorders. Automating video annotation using machine learning models could alleviate the costs of running lengthy behavioral experiments and enhance the reproducibility of study results. The latter is vital for translating behavioral research findings in mice to humans. This study has also provided insights into the amount of human-annotated training data needed to develop high-performing computer models, along with new understandings of how genetics shapes behavior.

TRex, a fast multi-animal tracking system with markerless identification, and 2D estimation of posture and visual fields.

Automated visual tracking of animals is rapidly becoming an indispensable tool for the study of behavior. It offers a quantitative methodology by which organisms' sensing and decision-making can be studied in a wide range of ecological contexts. Despite this, existing solutions tend to be challenging to deploy in practice, especially when considering long and/or high-resolution video-streams. Here, we present TRex, a fast and easy-to-use solution for tracking a large number of individuals simultaneously using background-subtraction with real-time (60 Hz) tracking performance for up to approximately 256 individuals and estimates 2D visual-fields, outlines, and head/rear of bilateral animals, both in open and closed-loop contexts. Additionally, TRex offers highly accurate, deep-learning-based visual identification of up to approximately 100 unmarked individuals, where it is between 2.5 and 46.7 times faster, and requires 2-10 times less memory, than comparable software (with relative performance increasing for more organisms/longer videos) and provides interactive data-exploration within an intuitive, platform-independent graphical user-interface.

Systems Neuroscience of Natural Behaviors in Rodents.

Animals evolved in complex environments, producing a wide range of behaviors, including navigation, foraging, prey capture, and conspecific interactions, which vary over timescales ranging from milliseconds to days. Historically, these behaviors have been the focus of study for ecology and ethology, while systems neuroscience has largely focused on short timescale behaviors that can be repeated thousands of times and occur in highly artificial environments. Thanks to recent advances in machine learning, miniaturization, and computation, it is newly possible to study freely moving animals in more natural conditions while applying systems techniques: performing temporally specific perturbations, modeling behavioral strategies, and recording from large numbers of neurons while animals are freely moving. The authors of this review are a group of scientists with deep appreciation for the common aims of systems neuroscience, ecology, and ethology. We believe it is an extremely exciting time to be a neuroscientist, as we have an opportunity to grow as a field, to embrace interdisciplinary, open, collaborative research to provide new insights and allow researchers to link knowledge across disciplines, species, and scales. Here we discuss the origins of ethology, ecology, and systems neuroscience in the context of our own work and highlight how combining approaches across these fields has provided fresh insights into our research. We hope this review facilitates some of these interactions and alliances and helps us all do even better science, together.

Assessment of Problem-Solving Skills and Inhibitory Control in Mice Using Water Escape Detour Test.

Despite the importance of emotional intelligence, its biological mechanism is still not well understood. For this reason, we have developed a rodent detour task which requires an animal to reach a highly desired object placed directly behind a transparent barrier that blocks the direct route to the target. This apparently simple task is highly dependent on the emotional control that is necessary to inhibit prepotent and counterproductive responses driven by the sight of a desired object. The water escape detour task designed for mice enables testing the ability to solve emotionally challenging problems, as well as identification of an impairment termed perseveration. Such a maladaptive reaction to a challenging situation is characterized by difficulty in terminating an unsuccessful response, leading to persistent repetition of inappropriate behavior. This issue is important because perseveration is associated with schizophrenia, drug abuse, and aging. © 2020 Wiley Periodicals LLC. Basic Protocol: Water escape detour task Support Protocol 1: Preparation of escape platform Support Protocol 2: Preparation of the transparent barrier Alternate Protocol: Water escape detour task for testing acute effects.

Rage Against the Machine: Advancing the study of aggression ethology via machine learning.

RATIONALE: Aggression, comorbid with neuropsychiatric disorders, exhibits with diverse clinical presentations and places a significant burden on patients, caregivers, and society. This diversity is observed because aggression is a complex behavior that can be ethologically demarcated as either appetitive (rewarding) or reactive (defensive), each with its own behavioral characteristics, functionality, and neural basis that may transition from adaptive to maladaptive depending on genetic and environmental factors. There has been a recent surge in the development of preclinical animal models for studying appetitive aggression-related behaviors and identifying the neural mechanisms guiding their progression and expression. However, adoption of these procedures is often impeded by the arduous task of manually scoring complex social interactions. Manual observations are generally susceptible to observer drift, long analysis times, and poor inter-rater reliability, and are further incompatible with the sampling frequencies required of modern neuroscience methods. OBJECTIVES: In this review, we discuss recent advances in the preclinical study of appetitive aggression in mice, paired with our perspective on the potential for machine learning techniques in producing automated, robust scoring of aggressive social behavior. We discuss critical considerations for implementing valid computer classifications within behavioral pharmacological studies. KEY RESULTS: Open-source automated classification platforms can match or exceed the performance of human observers while removing the confounds of observer drift, bias, and inter-rater reliability. Furthermore, unsupervised approaches can identify previously uncharacterized aggression-related behavioral repertoires in model species. DISCUSSION AND CONCLUSIONS: Advances in open-source computational approaches hold promise for overcoming current manual annotation caveats while also introducing and generalizing computational neuroethology to the greater behavioral neuroscience community. We propose that currently available open-source approaches are sufficient for overcoming the main limitations preventing wide adoption of machine learning within the context of preclinical aggression behavioral research.

An agent-based approach for modelling collective dynamics in animal groups distinguishing individual speed and orientation.

Collective dynamics in animal groups is a challenging theme for the modelling community, being treated with a wide range of approaches. This topic is here tackled by a discrete model. Entering in more details, each agent, represented by a material point, is assumed to move following a first-order Newtonian law, which distinguishes speed and orientation. In particular, the latter results from the balance of a given set of behavioural stimuli, each of them defined by a direction and a weight, that quantifies its relative importance. A constraint on the sum of the weights then avoids implausible simultaneous maximization/minimization of all movement traits. Our framework is based on a minimal set of rules and parameters and is able to capture and classify a number of collective group dynamics emerging from different individual preferred behaviour, which possibly includes attractive, repulsive and alignment stimuli. In the case of a system of animals subjected only to the first two behavioural inputs, we also show how analytical arguments allow us to a priori relate the equilibrium interparticle spacing to critical model coefficients. Our approach is then extended to account for the presence of predators with different hunting strategies, which impact on the behaviour of a prey population. Hints for model refinement and applications are finally given in the conclusive part of the article. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.

Noise-induced effects in collective dynamics and inferring local interactions from data.

In animal groups, individual decisions are best characterized by probabilistic rules. Furthermore, animals of many species live in small groups. Probabilistic interactions among small numbers of individuals lead to a so-called intrinsic noise at the group level. Theory predicts that the strength of intrinsic noise is not a constant but often depends on the collective state of the group; hence, it is also called a state-dependent noise or a multiplicative noise. Surprisingly, such noise may produce collective order. However, only a few empirical studies on collective behaviour have paid attention to such effects owing to the lack of methods that enable us to connect data with theory. Here, we demonstrate a method to characterize the role of stochasticity directly from high-resolution time-series data of collective dynamics. We do this by employing two well-studied individual-based toy models of collective behaviour. We argue that the group-level noise may encode important information about the underlying processes at the individual scale. In summary, we describe a method that enables us to establish connections between empirical data of animal (or cellular) collectives and the phenomenon of noise-induced states, a field that is otherwise largely limited to the theoretical literature. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.

A data-driven method for reconstructing and modelling social interactions in moving animal groups.

Group-living organisms that collectively migrate range from cells and bacteria to human crowds, and include swarms of insects, schools of fish, and flocks of birds or ungulates. Unveiling the behavioural and cognitive mechanisms by which these groups coordinate their movements is a challenging task. These mechanisms take place at the individual scale and can be described as a combination of interactions between individuals and interactions between these individuals and the physical obstacles in the environment. Thanks to the development of novel tracking techniques that provide large and accurate datasets, the main characteristics of individual and collective behavioural patterns can be quantified with an unprecedented level of precision. However, in a large number of studies, social interactions are usually described by force map methods that only have a limited capacity of explanation and prediction, being rarely suitable for a direct implementation in a concise and explicit mathematical model. Here, we present a general method to extract the interactions between individuals that are involved in the coordination of collective movements in groups of organisms. We then apply this method to characterize social interactions in two species of shoaling fish, the rummy-nose tetra (Hemigrammus rhodostomus) and the zebrafish (Danio rerio), which both present a burst-and-coast motion. From the detailed quantitative description of individual-level interactions, it is thus possible to develop a quantitative model of the emergent dynamics observed at the group level, whose predictions can be checked against experimental results. This method can be applied to a wide range of biological and social systems. This article is part of the theme issue 'Multi-scale analysis and modelling of collective migration in biological systems'.