Insect-Inspired Robots: Bridging Biological and Artificial Systems.

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.

Echo State Networks for Estimating Exteroceptive Conditions From Proprioceptive States in Quadruped Robots.

We propose a methodology based on reservoir computing for mapping local proprioceptive information acquired at the level of the leg joints of a simulated quadruped robot into exteroceptive and global information, including both the ground reaction forces at the level of the different legs and information about the type of terrain traversed by the robot. Both dynamic estimation and terrain classification can be achieved concurrently with the same reservoir computing structure, which serves as a soft sensor device. Simulation results are presented together with preliminary experiments on a real quadruped robot. They demonstrate the suitability of the proposed approach for various terrains and sensory system fault conditions. The strategy, which belongs to the class of data-driven models, is independent of the robotic mechanical design and can easily be generalized to different robotic structures.

Stacked autoencoders as new models for an accurate Alzheimer's disease classification support using resting-state EEG and MRI measurements.

OBJECTIVE: This retrospective and exploratory study tested the accuracy of artificial neural networks (ANNs) at detecting Alzheimer's disease patients with dementia (ADD) based on input variables extracted from resting-state electroencephalogram (rsEEG), structural magnetic resonance imaging (sMRI) or both. METHODS: For the classification exercise, the ANNs had two architectures that included stacked (autoencoding) hidden layers recreating input data in the output. The classification was based on LORETA source estimates from rsEEG activity recorded with 10-20 montage system (19 electrodes) and standard sMRI variables in 89 ADD and 45 healthy control participants taken from a national database. RESULTS: The ANN with stacked autoencoders and a deep leaning model representing both ADD and control participants showed classification accuracies in discriminating them of 80%, 85%, and 89% using rsEEG, sMRI, and rsEEG + sMRI features, respectively. The two ANNs with stacked autoencoders and a deep leaning model specialized for either ADD or control participants showed classification accuracies of 77%, 83%, and 86% using the same input features. CONCLUSIONS: The two architectures of ANNs using stacked (autoencoding) hidden layers consistently reached moderate to high accuracy in the discrimination between ADD and healthy control participants as a function of the rsEEG and sMRI features employed. SIGNIFICANCE: The present results encourage future multi-centric, prospective and longitudinal cross-validation studies using high resolution EEG techniques and harmonized clinical procedures towards clinical applications of the present ANNs.

Lyapunov approach to synchronization of chaotic systems with vanishing nonlinear perturbations: From static to dynamic couplings.

Synchronization of chaotic dynamics can be pursued by means of different coupling strategies. Definitely, master-slave coupling represents one of the most adopted solutions, even if it presents some limitations due to the coupling term's selection strategy. In this paper, we investigate the role of different structures of coupling terms on the synchronization properties of master-slave chaotic system configurations. Here, Lyapunov theory for linear systems with nonlinear vanishing perturbations is exploited. The obtained results allow to determine the capability of a static, dynamic, or mixed coupling connection in stabilizing the synchronization manifold, using linear techniques based on the root locus. This knowledge allows to design the coupling structure considering also the synchronization error transient features, which are, here, shown to improve in the presence of higher-order dynamic couplings. A number of cases of study, involving classical chaotic nonlinear systems, show the efficacy and simplicity of the application of the strategy proposed.

Integrative Biomimetics of Autonomous Hexapedal Locomotion.

Despite substantial advances in many different fields of neurorobotics in general, and biomimetic robots in particular, a key challenge is the integration of concepts: to collate and combine research on disparate and conceptually disjunct research areas in the neurosciences and engineering sciences. We claim that the development of suitable robotic integration platforms is of particular relevance to make such integration of concepts work in practice. Here, we provide an example for a hexapod robotic integration platform for autonomous locomotion. In a sequence of six focus sections dealing with aspects of intelligent, embodied motor control in insects and multipedal robots-ranging from compliant actuation, distributed proprioception and control of multiple legs, the formation of internal representations to the use of an internal body model-we introduce the walking robot HECTOR as a research platform for integrative biomimetics of hexapedal locomotion. Owing to its 18 highly sensorized, compliant actuators, light-weight exoskeleton, distributed and expandable hardware architecture, and an appropriate dynamic simulation framework, HECTOR offers many opportunities to integrate research effort across biomimetics research on actuation, sensory-motor feedback, inter-leg coordination, and cognitive abilities such as motion planning and learning of its own body size.

Perception-action map learning in controlled multiscroll systems applied to robot navigation.

In this paper a new technique for action-oriented perception in robots is presented. The paper starts from exploiting the successful implementation of the basic idea that perceptual states can be embedded into chaotic attractors whose dynamical evolution can be associated with sensorial stimuli. In this way, it can be possible to encode, into the chaotic dynamics, environment-dependent patterns. These have to be suitably linked to an action, executed by the robot, to fulfill an assigned mission. This task is addressed here: the action-oriented perception loop is closed by introducing a simple unsupervised learning stage, implemented via a bio-inspired structure based on the motor map paradigm. In this way, perceptual meanings, useful for solving a given task, can be autonomously learned, based on the environment-dependent patterns embedded into the controlled chaotic dynamics. The presented framework has been tested on a simulated robot and the performance have been successfully compared with other traditional navigation control paradigms. Moreover an implementation of the proposed architecture on a Field Programmable Gate Array is briefly outlined and preliminary experimental results on a roving robot are also reported.

Motor-Skill Learning in an Insect Inspired Neuro-Computational Control System.

In nature, insects show impressive adaptation and learning capabilities. The proposed computational model takes inspiration from specific structures of the insect brain: after proposing key hypotheses on the direct involvement of the mushroom bodies (MBs) and on their neural organization, we developed a new architecture for motor learning to be applied in insect-like walking robots. The proposed model is a nonlinear control system based on spiking neurons. MBs are modeled as a nonlinear recurrent spiking neural network (SNN) with novel characteristics, able to memorize time evolutions of key parameters of the neural motor controller, so that existing motor primitives can be improved. The adopted control scheme enables the structure to efficiently cope with goal-oriented behavioral motor tasks. Here, a six-legged structure, showing a steady-state exponentially stable locomotion pattern, is exposed to the need of learning new motor skills: moving through the environment, the structure is able to modulate motor commands and implements an obstacle climbing procedure. Experimental results on a simulated hexapod robot are reported; they are obtained in a dynamic simulation environment and the robot mimicks the structures of Drosophila melanogaster.

Separation and synchronization of piecewise linear chaotic systems.

In this paper a topic regarding the synchronization of chaotic systems is dealt with: the case of separation and synchronization of many chaotic signals generated by different chaotic circuits and combined together is examined. In particular, an observer based strategy has been adopted, and an approach for the simultaneous stabilization of many Luenberger observers has been investigated to face the problem of separation and synchronization. The design strategy is based on linear matrix inequalities (LMIs). Indeed, the LMI problem is referred to have a solution if a dual optimization problem admits a solution. In our case the feasibility condition, if it does exist, allows us to establish that the separation and synchronization problem for the chosen circuit admits a solution. Some numerical simulations are reported. Further results refer to an experimental circuit showing the suitability of the approach. Furthermore, the use of the proposed scheme to transmit two or more information masked into two or more multiplexed chaotic signals and the design of suitable parameters through the introduced technique based on LMIs are discussed.

Design and control of an IPMC wormlike robot.

This paper presents an innovative wormlike robot controlled by cellular neural networks (CNNs) and made of an ionic polymer-metal composite (IPMC) self-actuated skeleton. The IPMC actuators, from which it is made of, are new materials that behave similarly to biological muscles. The idea that inspired the work is the possibility of using IPMCs to design autonomous moving structures. CNNs have already demonstrated their powerfulness as new structures for bio-inspired locomotion generation and control. The control scheme for the proposed IPMC moving structure is based on CNNs. The wormlike robot is totally made of IPMCs, and each actuator has to carry its own weight. All the actuators are connected together without using any other additional part, thereby constituting the robot structure itself. Worm locomotion is performed by bending the actuators sequentially from "tail" to "head," imitating the traveling wave observed in real-world undulatory locomotion. The activation signals are generated by a CNN. In the authors' opinion, the proposed strategy represents a promising solution in the field of autonomous and light structures that are capable of reconfiguring and moving in line with spatial-temporal dynamics generated by CNNs.

A Fly-Inspired Mushroom Bodies Model for Sensory-Motor Control Through Sequence and Subsequence Learning.

Classification and sequence learning are relevant capabilities used by living beings to extract complex information from the environment for behavioral control. The insect world is full of examples where the presentation time of specific stimuli shapes the behavioral response. On the basis of previously developed neural models, inspired by Drosophila melanogaster, a new architecture for classification and sequence learning is here presented under the perspective of the Neural Reuse theory. Classification of relevant input stimuli is performed through resonant neurons, activated by the complex dynamics generated in a lattice of recurrent spiking neurons modeling the insect Mushroom Bodies neuropile. The network devoted to context formation is able to reconstruct the learned sequence and also to trace the subsequences present in the provided input. A sensitivity analysis to parameter variation and noise is reported. Experiments on a roving robot are reported to show the capabilities of the architecture used as a neural controller.

Modelling the insect Mushroom Bodies: Application to sequence learning.

Learning and reproducing temporal sequences is a fundamental ability used by living beings to adapt behaviour repertoire to environmental constraints. This paper is focused on the description of a model based on spiking neurons, able to learn and autonomously generate a sequence of events. The neural architecture is inspired by the insect Mushroom Bodies (MBs) that are a crucial centre for multimodal sensory integration and behaviour modulation. The sequence learning capability coexists, within the insect brain computational model, with all the other features already addressed like attention, expectation, learning classification and others. This is a clear example that a unique neural structure is able to cope concurrently with a plethora of behaviours. Simulation results and robotic experiments are reported and discussed.

Chaos control by using Motor Maps.

In this paper a new method for chaos control is proposed, consisting of an unsupervised neural network, namely a Motor Map. In particular a feedback entrainment scheme is adopted: a chaotic system with a given parameter set generates the reference trajectory for another chaotic system with different parameters to be controlled: the Motor Map is required to provide the appropriate time-varying gain value for the feedback signal. The state of the controlled system is considered as input to the Motor Map. Particular efforts have been paid to the feasibility of the implementation. Indeed, the simulations performed have been oriented to design a Motor Map suitable for an hardware realization, thus some restrictive hypotheses, such as for example a low number of neurons, have been assumed. A huge number of simulations has been carried out by considering as system to be controlled a Double Scroll Chua Attractor as well as other chaotic attractors. Several reference trajectories have also been considered: a limit cycle generated by a Chua's circuit with different parameters values, a double scroll Chua attractor, a chaotic attractor of the family of the Chua's circuit attractors. In all the simulations instead of controlling the whole state space, only two state variables have been fed back. Good results in terms of settling time (namely, the period in which the map learns the control task) and steady state errors have been obtained with a few neurons. The Motor Map based adaptive controller offers high performances, specially in the case when the reference trajectory is switched into another one. In this case, a specialization of the neurons constituting the Motor Map is observed: while a group of neurons learns the appropriate control law for a reference trajectory, another group specializes itself to control the system when the other trajectory is used as a reference. A discrete components electronic realization of the Motor Map is presented and experimental results confirming the simulation results are shown. (c) 2002 American Institute of Physics.

An adaptive, self-organizing dynamical system for hierarchical control of bio-inspired locomotion.

In this paper, dynamical systems made up of locally coupled nonlinear units are used to control the locomotion of bio-inspired robots and, in particular, a simulation of an insect-like hexapod robot. These controllers are inspired by the biological paradigm of central pattern generators and are responsible for generating a locomotion gait. A general structure, which is able to change the locomotion gait according to environmental conditions, is introduced. This structure is based on an adaptive system, implemented by motor maps, and is able to learn the correct locomotion gait on the basis of a reward function. The proposed control system is validated by a large number of simulations carried out in a dynamic environment for simulating legged robots.

Sensory feedback in CNN-based central pattern generators.

Central Pattern Generators (CPGs) are a suitable paradigm to solve the problem of locomotion control in walking robots. CPGs are able to generate feed-forward signals to achieve a proper coordination among the robot legs. In literature they are often modelled as networks of coupled nonlinear systems. However the topic of feedback in these systems is rarely addressed. On the other hand feedback is essential for locomotion. In this paper the CPG for a hexapod robot is implemented through Cellular Neural Networks (CNNs). Feedback is included in the CPG controller by exploiting the dynamic properties of the CPG motor-neurons, such as synchronization issue and local bifurcations. These universal paradigms provide the essential issues to include sensory feedback in CPG architectures based on coupled nonlinear systems. Experiments on a dynamic model of a hexapod robot are presented to validate the approach introduced.

Modeling the insect mushroom bodies: application to a delayed match-to-sample task.

Despite their small brains, insects show advanced capabilities in learning and task solving. Flies, honeybees and ants are becoming a reference point in neuroscience and a main source of inspiration for autonomous robot design issues and control algorithms. In particular, honeybees demonstrate to be able to autonomously abstract complex associations and apply them in tasks involving different sensory modalities within the insect brain. Mushroom Bodies (MBs) are worthy of primary attention for understanding memory and learning functions in insects. In fact, even if their main role regards olfactory conditioning, they are involved in many behavioral achievements and learning capabilities, as has been shown in honeybees and flies. Owing to the many neurogenetic tools, the fruit fly Drosophila became a source of information for the neuroarchitecture and biochemistry of the MBs, although the MBs of flies are by far simpler in organization than their honeybee orthologs. Electrophysiological studies, in turn, became available on the MBs of locusts and honeybees. In this paper a novel bio-inspired neural architecture is presented, which represents a generalized insect MB with the basic features taken from fruit fly neuroanatomy. By mimicking a number of different MB functions and architecture, we can replace and improve formerly used artificial neural networks. The model is a multi-layer spiking neural network where key elements of the insect brain, the antennal lobes, the lateral horn region, the MBs, and their mutual interactions are modeled. In particular, the model is based on the role of parts of the MBs named MB-lobes, where interesting processing mechanisms arise on the basis of spatio-temporal pattern formation. The introduced network is able to model learning mechanisms like olfactory conditioning seen in honeybees and flies and was found able also to perform more complex and abstract associations, like the delayed matching-to-sample tasks known only from honeybees. A biological basis of the proposed model is presented together with a detailed description of the architecture. Simulation results and remarks on the biological counterpart are also reported to demonstrate the possible applications of the designed computational model. Such neural architecture, able to autonomously learn complex associations is envisaged to be a suitable basis for an immediate implementation within an robot control architecture.

Learning expectation in insects: a recurrent spiking neural model for spatio-temporal representation.

Insects are becoming a reference point in Neuroscience for the study of biological aspects at the basis of cognitive processes. These animals have much simpler brains with respect to higher animals, showing, at the same time, impressive capability to adaptively react and take decisions in front of complex environmental situations. In this paper we propose a neural model inspired by the insect olfactory system, with particular attention to the fruit fly Drosophila melanogaster. This architecture is a multilayer spiking network, where each layer is inspired by the structures of the insect brain mainly involved in olfactory information processing, namely the Mushroom Bodies, the Lateral Horns and the Antennal Lobes. In the Antennal Lobes layer olfactory signals lead to a competition among sets of neurons, resulting in a pattern which is projected to the Mushroom Bodies layer. Here a competitive reaction-diffusion process leads to a spontaneous emerging of clusters. The Lateral Horns have been modeled as a delayed input-triggered resetting system. Using plastic recurrent connections, with the addition of simple learning mechanisms, the structure is able to realize a top-down modulation at the input level. This leads to the emergence of an attentional loop as well as to the arousal of basic expectation behaviors in case of subsequently presented stimuli. Simulation results and analysis on the biological plausibility of the architecture are provided and the role of noise in the network is reported.

An insect-inspired bionic sensor for tactile localization and material classification with state-dependent modulation.

INSECTS CARRY A PAIR OF ANTENNAE ON THEIR HEAD: multimodal sensory organs that serve a wide range of sensory-guided behaviors. During locomotion, antennae are involved in near-range orientation, for example in detecting, localizing, probing, and negotiating obstacles. Here we present a bionic, active tactile sensing system inspired by insect antennae. It comprises an actuated elastic rod equipped with a terminal acceleration sensor. The measurement principle is based on the analysis of damped harmonic oscillations registered upon contact with an object. The dominant frequency of the oscillation is extracted to determine the distance of the contact point along the probe and basal angular encoders allow tactile localization in a polar coordinate system. Finally, the damping behavior of the registered signal is exploited to determine the most likely material. The tactile sensor is tested in four approaches with increasing neural plausibility: first, we show that peak extraction from the Fourier spectrum is sufficient for tactile localization with position errors below 1%. Also, the damping property of the extracted frequency is used for material classification. Second, we show that the Fourier spectrum can be analysed by an Artificial Neural Network (ANN) which can be trained to decode contact distance and to classify contact materials. Thirdly, we show how efficiency can be improved by band-pass filtering the Fourier spectrum by application of non-negative matrix factorization. This reduces the input dimension by 95% while reducing classification performance by 8% only. Finally, we replace the FFT by an array of spiking neurons with gradually differing resonance properties, such that their spike rate is a function of the input frequency. We show that this network can be applied to detect tactile contact events of a wheeled robot, and how detrimental effects of robot velocity on antennal dynamics can be suppressed by state-dependent modulation of the input signals.

Characterizing Deep Brain Stimulation effects in computationally efficient neural network models.

BACKGROUND: Recent studies on the medical treatment of Parkinson's disease (PD) led to the introduction of the so called Deep Brain Stimulation (DBS) technique. This particular therapy allows to contrast actively the pathological activity of various Deep Brain structures, responsible for the well known PD symptoms. This technique, frequently joined to dopaminergic drugs administration, replaces the surgical interventions implemented to contrast the activity of specific brain nuclei, called Basal Ganglia (BG). This clinical protocol gave the possibility to analyse and inspect signals measured from the electrodes implanted into the deep brain regions. The analysis of these signals led to the possibility to study the PD as a specific case of dynamical synchronization in biological neural networks, with the advantage to apply the theoretical analysis developed in such scientific field to find efficient treatments to face with this important disease. Experimental results in fact show that the PD neurological diseases are characterized by a pathological signal synchronization in BG. Parkinsonian tremor, for example, is ascribed to be caused by neuron populations of the Thalamic and Striatal structures that undergo an abnormal synchronization. On the contrary, in normal conditions, the activity of the same neuron populations do not appear to be correlated and synchronized. RESULTS: To study in details the effect of the stimulation signal on a pathological neural medium, efficient models of these neural structures were built, which are able to show, without any external input, the intrinsic properties of a pathological neural tissue, mimicking the BG synchronized dynamics.We start considering a model already introduced in the literature to investigate the effects of electrical stimulation on pathologically synchronized clusters of neurons. This model used Morris Lecar type neurons. This neuron model, although having a high level of biological plausibility, requires a large computational effort to simulate large scale networks. For this reason we considered a reduced order model, the Izhikevich one, which is computationally much lighter. The comparison between neural lattices built using both neuron models provided comparable results, both without traditional stimulation and in presence of all the stimulation protocols. This was a first result toward the study and simulation of the large scale neural networks involved in pathological dynamics.Using the reduced order model an inspection on the activity of two neural lattices was also carried out at the aim to analyze how the stimulation in one area could affect the dynamics in another area, like the usual medical treatment protocols require.The study of population dynamics that was carried out allowed us to investigate, through simulations, the positive effects of the stimulation signals in terms of desynchronization of the neural dynamics. CONCLUSIONS: The results obtained constitute a significant added value to the analysis of synchronization and desynchronization effects due to neural stimulation. This work gives the opportunity to more efficiently study the effect of stimulation in large scale yet computationally efficient neural networks. Results were compared both with the other mathematical models, using Morris Lecar and Izhikevich neurons, and with simulated Local Field Potentials (LFP).

Learning anticipation via spiking networks: application to navigation control.

In this paper, we introduce a network of spiking neurons devoted to navigation control. Three different examples, dealing with stimuli of increasing complexity, are investigated. In the first one, obstacle avoidance in a simulated robot is achieved through a network of spiking neurons. In the second example, a second layer is designed aiming to provide the robot with a target approaching system, making it able to move towards visual targets. Finally, a network of spiking neurons for navigation based on visual cues is introduced. In all cases, the robot was assumed to rely on some a priori known responses to low-level sensors (i.e., to contact sensors in the case of obstacles, to proximity target sensors in the case of visual targets, or to the visual target for navigation with visual cues). Based on their knowledge, the robot has to learn the response to high-level stimuli (i.e., range finder sensors or visual input). The biologically plausible paradigm of spike-timing-dependent plasticity (STDP) is included in the network to make the system able to learn high-level responses that guide navigation through a simple unstructured environment. The learning procedure is based on classical conditioning.

Cellular Nonlinear Networks for the emergence of perceptual states: application to robot navigation control.

In this paper a new general purpose perceptual control architecture, based on nonlinear neural lattices, is presented and applied to solve robot navigation tasks. Insects show the ability to react to certain stimuli with simple reflexes, using direct sensory-motor pathways, which can be considered as basic behaviors, inherited and pre-wired. Relevant brain centres, known as Mushroom Bodies (MB) and Central Complex (CX) were recently identified in insects: though their functional details are not yet fully understood, it is known that they provide secondary pathways allowing the emergence of cognitive behaviors. These are gained through the coordination of the basic abilities to satisfy the insect's needs. Taking inspiration from this evidence, our architecture modulates, through a reinforcement learning, a set of competitive and concurrent basic behaviors in order to accomplish the task assigned through a reward function. The core of the architecture is constituted by the so-called Representation layer, used to create a concise picture of the current environment situation, fusing together different stimuli for the emergence of perceptual states. These perceptual states are steady state solutions of lattices of Reaction-Diffusion Cellular Nonlinear Networks (RD-CNN), designed to show Turing patterns. The exploitation of the dynamics of the multiple equilibria of the network is emphasized through the adaptive shaping of the basins of attraction for each emerged pattern. New experimental campaigns on standard robotic platforms are reported to demonstrate the potentiality and the effectiveness of the approach.