The Dynamics of Social Interaction Among Evolved Model Agents.

We offer three advances to the perceptual crossing simulation studies, which are aimed at challenging methodological individualism in the analysis of social cognition. First, we evolve and systematically test agents in rigorous conditions, identifying a set of 26 "robust circuits" with consistently high and generalizing performance. Next, we transform the sensor from discrete to continuous, facilitating a bifurcation analysis of the dynamics that shows that nonequilibrium dynamics are key to the mutual maintenance of interaction. Finally, we examine agents' performance with partners whose neural controllers are different from their own and with decoy objects of fixed frequency and amplitude. Nonclonal performance varies and is not predicted by genotypic distance. Frequency-amplitude values that fool the focal agent do not include the agent's own values. Altogether, our findings accentuate the importance of dynamical and nonclonal analyses for simulated sociality, emphasize the role of dialogue between artificial and human studies, and highlight the contributions of simulation studies to understanding social interactions.

Fluorescently Labeled Ceramides and 1-Deoxyceramides: Synthesis, Characterization, and Cellular Distribution Studies.

Ceramides (Cer) are bioactive sphingolipids that have been proposed as potential disease biomarkers since they are involved in several cellular stress responses, including apoptosis and senescence. 1-Deoxyceramides (1-deoxyCer), a particular subtype of noncanonical sphingolipids, have been linked to the pathogenesis of type II diabetes. To investigate the metabolism of these bioactive lipids, as well as to have a better understanding of the signaling processes where they participate, it is essential to expand the toolbox of fluorescent sphingolipid probes exhibiting complementary subcellular localization. Herein, we describe a series of new sphingolipid probes tagged with two different organic fluorophores, a far-red/NIR-emitting coumarin derivative (COUPY) and a green-emitting BODIPY. The assembly of the probes involved a combination of olefin cross metathesis and click chemistry reactions as key steps, and these fluorescent ceramide analogues exhibited excellent emission quantum yields, being the Stokes' shifts of the COUPY derivatives much higher than those of the BODIPY counterparts. Confocal microscopy studies in HeLa cells confirmed an excellent cellular permeability for these sphingolipid probes and revealed that most of the vesicles stained by COUPY probes were either lysosomes or endosomes, whereas BODIPY probes accumulated either in Golgi apparatus or in nonlysosomal intracellular vesicles. The fact that the two sets of fluorescent Cer probes have such different staining patterns indicates that their subcellular distribution is not entirely defined by the sphingolipid moiety but rather influenced by the fluorophore.

Utilidad del monitoreo continuo del electroencefalograma en el paciente crítico / Utility of continuous electroencephalogram monitoring in the critical patients

Introducción: El monitoreo continuo del Electroencefalograma, es la recogida simultánea de la actividad cerebral y la conducta clínica por un período de horas a días. Por el alto costo de la técnica aún no está muy difundida. Objetivos: Evaluar la utilidad del monitoreo electroencefalográfico continuo en el paciente crítico. Métodos: Se realizó un estudio descriptivo, retrospectivo y longitudinal en 118 sujetos mayores de 19 años ingresados en las unidades de terapia del Hospital Clínico Quirúrgico Hermanos Ameijeiras; entre noviembre 2016 a octubre 2018 con indicación de un Electroencefalograma continuo. Se consideraron variables clínicas y electroencefalográficas: escala de Glasgow, ocurrencia de crisis, diagnóstico, estado al egreso, anormalidad del Electroencefalograma, descargas epileptiformes, sospecha de estatus epiléptico no convulsivo por electroencefalograma entre otras. Los datos se procesaron con test de Chi cuadrado, test de Mc Nemar y test t de student, se empleó un nivel de significación de p≤0.05. Resultados: 60 de los pacientes pertenecían al sexo femenino, la mediana de las edades fue 67,5 años. La escala de Glasgow mostró asociación significativa con el grado de anormalidad del electroencefalograma (p=0,001), es la arreactividad y la discontinuidad de la actividad de base predictores de pobre pronóstico. Se observaron descargas epileptiformes periódicas en 100 pacientes. Se definió estatus epiléptico no convulsivo en 56 sujetos (37,28 por ciento) y en 81 sujetos (68,64 por ciento) el resultado del electroencefalograma motivó una conducta médica. Conclusiones: El monitoreo continuo del electroencefalograma es útil en el diagnóstico y manejo del paciente con episodios no convulsivos, permite formular un pronóstico neurológico y orientó la conducta médica(AU)

Introduction: The continuous monitoring of the electroencephalogram is the simultaneous collection of brain activity and clinical behavior for a period of hours to days. Due to the high cost of the technique, it is not yet widely used. Objectives: To evaluate the usefulness of continuous electroencephalographic monitoring in critically ill patients. Methods: A descriptive, retrospective and longitudinal study was carried out in 118 subjects over 19 years of age admitted to the therapy units at Hermanos Ameijeiras Surgical Clinical Hospital; from November 2016 to October 2018. They were indicated a continuous electroencephalogram. Clinical and electroencephalographic variables were considered, such as Glasgow scale, seizure occurrence, diagnosis, discharge status, electroencephalogram abnormality, epileptiform discharges, suspicion of nonconvulsive status epilepticus by electroencephalogram, among others. The data was processed with the Chi square test, the Mc Nemar test and the student's t test, using significance level of p≤0.05. Results: Sixty patients were female, the median age was 67.5 years. The Glasgow scale showed significant association with the degree of electroencephalogram abnormality (p=0.001). A reactivity and discontinuity of baseline activity are predictors of poor prognosis. Periodic epileptiform discharges were observed in 100 patients. Non-convulsive status epilepticus was defined in 56 subjects (37.28 percent) and in 81 subjects (68.64 percent) the result of the electroencephalogram motivated a medical procedure. Conclusions: The continuous monitoring of the electroencephalogram is useful in the diagnosis and management of patients with non-convulsive episodes, it allows formulating a neurological prognosis and guided medical conduct(AU)

Reinforcement Learning for Central Pattern Generation in Dynamical Recurrent Neural Networks.

Lifetime learning, or the change (or acquisition) of behaviors during a lifetime, based on experience, is a hallmark of living organisms. Multiple mechanisms may be involved, but biological neural circuits have repeatedly demonstrated a vital role in the learning process. These neural circuits are recurrent, dynamic, and non-linear and models of neural circuits employed in neuroscience and neuroethology tend to involve, accordingly, continuous-time, non-linear, and recurrently interconnected components. Currently, the main approach for finding configurations of dynamical recurrent neural networks that demonstrate behaviors of interest is using stochastic search techniques, such as evolutionary algorithms. In an evolutionary algorithm, these dynamic recurrent neural networks are evolved to perform the behavior over multiple generations, through selection, inheritance, and mutation, across a population of solutions. Although, these systems can be evolved to exhibit lifetime learning behavior, there are no explicit rules built into these dynamic recurrent neural networks that facilitate learning during their lifetime (e.g., reward signals). In this work, we examine a biologically plausible lifetime learning mechanism for dynamical recurrent neural networks. We focus on a recently proposed reinforcement learning mechanism inspired by neuromodulatory reward signals and ongoing fluctuations in synaptic strengths. Specifically, we extend one of the best-studied and most-commonly used dynamic recurrent neural networks to incorporate the reinforcement learning mechanism. First, we demonstrate that this extended dynamical system (model and learning mechanism) can autonomously learn to perform a central pattern generation task. Second, we compare the robustness and efficiency of the reinforcement learning rules in relation to two baseline models, a random walk and a hill-climbing walk through parameter space. Third, we systematically study the effect of the different meta-parameters of the learning mechanism on the behavioral learning performance. Finally, we report on preliminary results exploring the generality and scalability of this learning mechanism for dynamical neural networks as well as directions for future work.

Synthesis and characterization of bichromophoric 1-deoxyceramides as FRET probes.

The suitability as FRET probes of two bichromophoric 1-deoxydihydroceramides containing a labelled spisulosine derivative as a sphingoid base and two differently ω-labelled fluorescent palmitic acids has been evaluated. The ceramide synthase (CerS) catalyzed metabolic incorporation of ω-azido palmitic acid into the above labeled spisulosine to render the corresponding ω-azido 1-deoxyceramide has been studied in several cell lines. In addition, the strain-promoted click reaction between this ω-azido 1-deoxyceramide and suitable fluorophores has been optimized to render the target bichromophoric 1-deoxydihydroceramides. These results pave the way for the development of FRET-based assays as a new tool to study sphingolipid metabolism.

A Neuromechanical Model of Multiple Network Rhythmic Pattern Generators for Forward Locomotion in C. elegans.

Multiple mechanisms contribute to the generation, propagation, and coordination of the rhythmic patterns necessary for locomotion in Caenorhabditis elegans. Current experiments have focused on two possibilities: pacemaker neurons and stretch-receptor feedback. Here, we focus on whether it is possible that a chain of multiple network rhythmic pattern generators in the ventral nerve cord also contribute to locomotion. We use a simulation model to search for parameters of the anatomically constrained ventral nerve cord circuit that, when embodied and situated, can drive forward locomotion on agar, in the absence of pacemaker neurons or stretch-receptor feedback. Systematic exploration of the space of possible solutions reveals that there are multiple configurations that result in locomotion that is consistent with certain aspects of the kinematics of worm locomotion on agar. Analysis of the best solutions reveals that gap junctions between different classes of motorneurons in the ventral nerve cord can play key roles in coordinating the multiple rhythmic pattern generators.

Persistent thermal input controls steering behavior in Caenorhabditis elegans.

Motile organisms actively detect environmental signals and migrate to a preferable environment. Especially, small animals convert subtle spatial difference in sensory input into orientation behavioral output for directly steering toward a destination, but the neural mechanisms underlying steering behavior remain elusive. Here, we analyze a C. elegans thermotactic behavior in which a small number of neurons are shown to mediate steering toward a destination temperature. We construct a neuroanatomical model and use an evolutionary algorithm to find configurations of the model that reproduce empirical thermotactic behavior. We find that, in all the evolved models, steering curvature are modulated by temporally persistent thermal signals sensed beyond the time scale of sinusoidal locomotion of C. elegans. Persistent rise in temperature decreases steering curvature resulting in straight movement of model worms, whereas fall in temperature increases curvature resulting in crooked movement. This relation between temperature change and steering curvature reproduces the empirical thermotactic migration up thermal gradients and steering bias toward higher temperature. Further, spectrum decomposition of neural activities in model worms show that thermal signals are transmitted from a sensory neuron to motor neurons on the longer time scale than sinusoidal locomotion of C. elegans. Our results suggest that employments of temporally persistent sensory signals enable small animals to steer toward a destination in natural environment with variable, noisy, and subtle cues.

Sources of predictive information in dynamical neural networks.

Behavior involves the ongoing interaction between an organism and its environment. One of the prevailing theories of adaptive behavior is that organisms are constantly making predictions about their future environmental stimuli. However, how they acquire that predictive information is still poorly understood. Two complementary mechanisms have been proposed: predictions are generated from an agent's internal model of the world or predictions are extracted directly from the environmental stimulus. In this work, we demonstrate that predictive information, measured using bivariate mutual information, cannot distinguish between these two kinds of systems. Furthermore, we show that predictive information cannot distinguish between organisms that are adapted to their environments and random dynamical systems exposed to the same environment. To understand the role of predictive information in adaptive behavior, we need to be able to identify where it is generated. To do this, we decompose information transfer across the different components of the organism-environment system and track the flow of information in the system over time. To validate the proposed framework, we examined it on a set of computational models of idealized agent-environment systems. Analysis of the systems revealed three key insights. First, predictive information, when sourced from the environment, can be reflected in any agent irrespective of its ability to perform a task. Second, predictive information, when sourced from the nervous system, requires special dynamics acquired during the process of adapting to the environment. Third, the magnitude of predictive information in a system can be different for the same task if the environmental structure changes.

Click and count: specific detection of acid ceramidase activity in live cells.

The use of intact cells in medical research offers a number of advantages over employing cell-free systems. In diagnostics, cells isolated from liquid biopsies can be directly used, speeding up the time of analysis and diminishing the risk of protein degradation by sample manipulation. In drug discovery, studies in live cells take into account aspects neglected in cell-free systems, such as uptake, metabolization, and subcellular concentration by compartmentalization of potential drug candidates. Therefore, probes for studies in cellulo are of paramount importance. Acid ceramidase (AC) is a lysosomal enzyme that hydrolyses ceramides into sphingoid bases and fatty acids. The essential role of this enzyme in the outburst and progress of several diseases, some of them still incurable, is well sustained. Despite the great clinical relevance of AC as a biomarker and therapeutic target, the specific monitoring of AC activity in live cells has remained elusive due to the concomitant existence of neutral and alkaline ceramidases. In this work, we report that 1-deoxydihydroceramides are exclusively hydrolysed by AC. Using N-octanoyl-18-azidodeoxysphinganine as a probe and a BODIPY-substituted bicyclononyne, we show the click-reliant predominant staining of lysosomes, with extra-lysosomal labeling also occurring in some cells. Importantly, using pharmacological and genetic tools together with high resolution mass spectrometry, we demonstrate that both lysosomal and extra-lysosomal staining are AC-dependent. These findings are translated into the specific flow cytometry monitoring of AC activity in intact cells, which fills an important gap in the field of diseases linked to altered AC activity.

A Mechanism-Based Sphingosine-1-phosphate Lyase Inhibitor.

The synthesis of a series of vinylated analogues of sphingosine-1-phosphate together with their unambiguous configurational assignment by VCD methods is reported. Among them, compound RBM10-8 can irreversibly inhibit human sphingosine-1-phosphate lyase (hS1PL) while behaving also as an enzyme substrate. These findings, together with the postulated mechanism for S1PL activity, reinforce the role of RBM10-8 as a new mechanism-based hS1PL inhibitor.

Optimal modularity and memory capacity of neural reservoirs.

The neural network is a powerful computing framework that has been exploited by biological evolution and by humans for solving diverse problems. Although the computational capabilities of neural networks are determined by their structure, the current understanding of the relationships between a neural network's architecture and function is still primitive. Here we reveal that a neural network's modular architecture plays a vital role in determining the neural dynamics and memory performance of the network of threshold neurons. In particular, we demonstrate that there exists an optimal modularity for memory performance, where a balance between local cohesion and global connectivity is established, allowing optimally modular networks to remember longer. Our results suggest that insights from dynamical analysis of neural networks and information-spreading processes can be leveraged to better design neural networks and may shed light on the brain's modular organization.

Embodied Dyadic Interaction Increases Complexity of Neural Dynamics: A Minimal Agent-Based Simulation Model.

The concept of social interaction is at the core of embodied and enactive approaches to social cognitive processes, yet scientifically it remains poorly understood. Traditionally, cognitive science had relegated all behavior to being the end result of internal neural activity. However, the role of feedback from the interactions between agent and their environment has become increasingly important to understanding behavior. We focus on the role that social interaction plays in the behavioral and neural activity of the individuals taking part in it. Is social interaction merely a source of complex inputs to the individual, or can social interaction increase the individuals' own complexity? Here we provide a proof of concept of the latter possibility by artificially evolving pairs of simulated mobile robots to increase their neural complexity, which consistently gave rise to strategies that take advantage of their capacity for interaction. We found that during social interaction, the neural controllers exhibited dynamics of higher-dimensionality than were possible in social isolation. Moreover, by testing evolved strategies against unresponsive ghost partners, we demonstrated that under some conditions this effect was dependent on mutually responsive co-regulation, rather than on the mere presence of another agent's behavior as such. Our findings provide an illustration of how social interaction can augment the internal degrees of freedom of individuals who are actively engaged in participation.

Potential role of a ventral nerve cord central pattern generator in forward and backward locomotion in Caenorhabditis elegans.

C. elegans locomotes in an undulatory fashion, generating thrust by propagating dorsoventral bends along its body. Although central pattern generators (CPGs) are typically involved in animal locomotion, their presence in C. elegans has been questioned, mainly because there has been no evident circuit that supports intrinsic network oscillations. With a fully reconstructed connectome, the question of whether it is possible to have a CPG in the ventral nerve cord (VNC) of C. elegans can be answered through computational models. We modeled a repeating neural unit based on segmentation analysis of the connectome. We then used an evolutionary algorithm to determine the unknown physiological parameters of each neuron so as to match the features of the neural traces of the worm during forward and backward locomotion. We performed 1,000 evolutionary runs and consistently found configurations of the neural circuit that produced oscillations matching the main characteristic observed in experimental recordings. In addition to providing an existence proof for the possibility of a CPG in the VNC, we suggest a series of testable hypotheses about its operation. More generally, we show the feasibility and fruitfulness of a methodology to study behavior based on a connectome, in the absence of complete neurophysiological details.

From head to tail: a neuromechanical model of forward locomotion in Caenorhabditis elegans.

With 302 neurons and a near-complete reconstruction of the neural and muscle anatomy at the cellular level, Caenorhabditis elegans is an ideal candidate organism to study the neuromechanical basis of behaviour. Yet despite the breadth of knowledge about the neurobiology, anatomy and physics of C. elegans, there are still a number of unanswered questions about one of its most basic and fundamental behaviours: forward locomotion. How the rhythmic pattern is generated and propagated along the body is not yet well understood. We report on the development and analysis of a model of forward locomotion that integrates the neuroanatomy, neurophysiology and body mechanics of the worm. Our model is motivated by experimental analysis of the structure of the ventral cord circuitry and the effect of local body curvature on nearby motoneurons. We developed a neuroanatomically grounded model of the head motoneuron circuit and the ventral nerve cord circuit. We integrated the neural model with an existing biomechanical model of the worm's body, with updated musculature and stretch receptors. Unknown parameters were evolved using an evolutionary algorithm to match the speed of the worm on agar. We performed 100 evolutionary runs and consistently found electrophysiological configurations that reproduced realistic control of forward movement. The ensemble of successful solutions reproduced key experimental observations that they were not designed to fit, including the wavelength and frequency of the propagating wave. Analysis of the ensemble revealed that head motoneurons SMD and RMD are sufficient to drive dorsoventral undulations in the head and neck and that short-range posteriorly directed proprioceptive feedback is sufficient to propagate the wave along the rest of the body.This article is part of a discussion meeting issue 'Connectome to behaviour: modelling C. elegans at cellular resolution'.

Click chemistry in sphingolipid research.

The term "click chemistry" was firstly coined by K. B. Sharpless in 2001 to refer to reactions that are high yielding, wide in scope, produce only easily removable byproducts and are stereospecific and simple to perform. Since then, this concept has been further developed and a large number of chemical reactions that fulfil totally or partially these criteria have been identified, contributing to widen the structural diversity in drug discovery campaigns, and providing chemical biologists with invaluable tools for the development of bioorthogonal reactions. In this context, several examples of the application of this concept in glycobiology and in the study of protein-protein, protein-nucleic acid and even protein-lipid interactions can be found. However, far fewer protocols have been described for the interrogation of cellular processes related to sphingolipid functions and metabolism. This review seeks to provide a concise overview of the most recent additions of click chemistry strategies to the current chemical biology toolbox, including the use of sphingolipid probes suitably functionalized for in situ click reactions, and the preparation of novel sphingolipid analogues whose design has been driven by the versatility of the archetypal [3 + 2] azide-alkyne cycloaddition.

The whole worm: brain-body-environment models of C. elegans.

Brain, body and environment are in continuous dynamical interaction, and it is becoming increasingly clear that an animal's behavior must be understood as a product not only of its nervous system, but also of the ongoing feedback of this neural activity through the biomechanics of its body and the ecology of its environment. Modeling has an essential integrative role to play in such an understanding. But successful whole-animal modeling requires an animal for which detailed behavioral, biomechanical and neural information is available and a modeling methodology which can gracefully cope with the constantly changing balance of known and unknown biological constraints. Here we review recent progress on both optogenetic techniques for imaging and manipulating neural activity and neuromechanical modeling in the nematode worm Caenorhabditis elegans. This work demonstrates both the feasibility and challenges of whole-animal modeling.

A stochastic neuronal model predicts random search behaviors at multiple spatial scales in C. elegans.

Random search is a behavioral strategy used by organisms from bacteria to humans to locate food that is randomly distributed and undetectable at a distance. We investigated this behavior in the nematode Caenorhabditis elegans, an organism with a small, well-described nervous system. Here we formulate a mathematical model of random search abstracted from the C. elegans connectome and fit to a large-scale kinematic analysis of C. elegans behavior at submicron resolution. The model predicts behavioral effects of neuronal ablations and genetic perturbations, as well as unexpected aspects of wild type behavior. The predictive success of the model indicates that random search in C. elegans can be understood in terms of a neuronal flip-flop circuit involving reciprocal inhibition between two populations of stochastic neurons. Our findings establish a unified theoretical framework for understanding C. elegans locomotion and a testable neuronal model of random search that can be applied to other organisms.

Information Flow through a Model of the C. elegans Klinotaxis Circuit.

Understanding how information about external stimuli is transformed into behavior is one of the central goals of neuroscience. Here we characterize the information flow through a complete sensorimotor circuit: from stimulus, to sensory neurons, to interneurons, to motor neurons, to muscles, to motion. Specifically, we apply a recently developed framework for quantifying information flow to a previously published ensemble of models of salt klinotaxis in the nematode worm Caenorhabditis elegans. Despite large variations in the neural parameters of individual circuits, we found that the overall information flow architecture circuit is remarkably consistent across the ensemble. This suggests structural connectivity is not necessarily predictive of effective connectivity. It also suggests information flow analysis captures general principles of operation for the klinotaxis circuit. In addition, information flow analysis reveals several key principles underlying how the models operate: (1) Interneuron class AIY is responsible for integrating information about positive and negative changes in concentration, and exhibits a strong left/right information asymmetry. (2) Gap junctions play a crucial role in the transfer of information responsible for the information symmetry observed in interneuron class AIZ. (3) Neck motor neuron class SMB implements an information gating mechanism that underlies the circuit's state-dependent response. (4) The neck carries more information about small changes in concentration than about large ones, and more information about positive changes in concentration than about negative ones. Thus, not all directions of movement are equally informative for the worm. Each of these findings corresponds to hypotheses that could potentially be tested in the worm. Knowing the results of these experiments would greatly refine our understanding of the neural circuit underlying klinotaxis.

Connecting a connectome to behavior: an ensemble of neuroanatomical models of C. elegans klinotaxis.

Increased efforts in the assembly and analysis of connectome data are providing new insights into the principles underlying the connectivity of neural circuits. However, despite these considerable advances in connectomics, neuroanatomical data must be integrated with neurophysiological and behavioral data in order to obtain a complete picture of neural function. Due to its nearly complete wiring diagram and large behavioral repertoire, the nematode worm Caenorhaditis elegans is an ideal organism in which to explore in detail this link between neural connectivity and behavior. In this paper, we develop a neuroanatomically-grounded model of salt klinotaxis, a form of chemotaxis in which changes in orientation are directed towards the source through gradual continual adjustments. We identify a minimal klinotaxis circuit by systematically searching the C. elegans connectome for pathways linking chemosensory neurons to neck motor neurons, and prune the resulting network based on both experimental considerations and several simplifying assumptions. We then use an evolutionary algorithm to find possible values for the unknown electrophsyiological parameters in the network such that the behavioral performance of the entire model is optimized to match that of the animal. Multiple runs of the evolutionary algorithm produce an ensemble of such models. We analyze in some detail the mechanisms by which one of the best evolved circuits operates and characterize the similarities and differences between this mechanism and other solutions in the ensemble. Finally, we propose a series of experiments to determine which of these alternatives the worm may be using.