A Deep Learning Approach for Surface Crack Classification and Segmentation in Unmanned Aerial Vehicle Assisted Infrastructure Inspections.

Surface crack detection is an integral part of infrastructure health surveys. This work presents a transformative shift towards rapid and reliable data collection capabilities, dramatically reducing the time spent on inspecting infrastructures. Two unmanned aerial vehicles (UAVs) were deployed, enabling the capturing of images simultaneously for efficient coverage of the structure. The suggested drone hardware is especially suitable for the inspection of infrastructure with confined spaces that UAVs with a broader footprint are incapable of accessing due to a lack of safe access or positioning data. The collected image data were analyzed using a binary classification convolutional neural network (CNN), effectively filtering out images containing cracks. A comparison of state-of-the-art CNN architectures against a novel CNN layout "CrackClassCNN" was investigated to obtain the optimal layout for classification. A Segment Anything Model (SAM) was employed to segment defect areas, and its performance was benchmarked against manually annotated images. The suggested "CrackClassCNN" achieved an accuracy rate of 95.02%, and the SAM segmentation process yielded a mean Intersection over Union (IoU) score of 0.778 and an F1 score of 0.735. It was concluded that the selected UAV platform, the communication network, and the suggested processing techniques were highly effective in surface crack detection.

Evaluation of linear and non-linear activation dynamics models for insect muscle.

In computational modelling of sensory-motor control, the dynamics of muscle contraction is an important determinant of movement timing and joint stiffness. This is particularly so in animals with many slow muscles, as is the case in insects-many of which are important models for sensory-motor control. A muscle model is generally used to transform motoneuronal input into muscle force. Although standard models exist for vertebrate muscle innervated by many motoneurons, there is no agreement on a parametric model for single motoneuron stimulation of invertebrate muscle. Although several different models have been proposed, they have never been evaluated using a common experimental data set. We evaluate five models for isometric force production of a well-studied model system: the locust hind leg tibial extensor muscle. The response of this muscle to motoneuron spikes is best modelled as a non-linear low-pass system. Linear first-order models can approximate isometric force time courses well at high spike rates, but they cannot account for appropriate force time courses at low spike rates. A linear third-order model performs better, but only non-linear models can account for frequency-dependent change of decay time and force potentiation at intermediate stimulus frequencies. Some of the differences among published models are due to differences among experimental data sets. We developed a comprehensive toolbox for modelling muscle activation dynamics, and optimised model parameters using one data set. The "Hatze-Zakotnik model" that emphasizes an accurate single-twitch time course and uses frequency-dependent modulation of the twitch for force potentiation performs best for the slow motoneuron. Frequency-dependent modulation of a single twitch works less well for the fast motoneuron. The non-linear "Wilson" model that optimises parameters to all data set parts simultaneously performs better here. Our open-access toolbox provides powerful tools for researchers to fit appropriate models to a range of insect muscles.

Stable phase-shift despite quasi-rhythmic movements: a CPG-driven dynamic model of active tactile exploration in an insect.

An essential component of autonomous and flexible behavior in animals is active exploration of the environment, allowing for perception-guided planning and control of actions. An important sensory system involved is active touch. Here, we introduce a general modeling framework of Central Pattern Generators (CPGs) for movement generation in active tactile exploration behavior. The CPG consists of two network levels: (i) phase-coupled Hopf oscillators for rhythm generation, and (ii) pattern formation networks for capturing the frequency and phase characteristics of individual joint oscillations. The model captured the natural, quasi-rhythmic joint kinematics as observed in coordinated antennal movements of walking stick insects. Moreover, it successfully produced tactile exploration behavior on a three-dimensional skeletal model of the insect antennal system with physically realistic parameters. The effect of proprioceptor ablations could be simulated by changing the amplitude and offset parameters of the joint oscillators, only. As in the animal, the movement of both antennal joints was coupled with a stable phase difference, despite the quasi-rhythmicity of the joint angle time courses. We found that the phase-lead of the distal scape-pedicel (SP) joint relative to the proximal head-scape (HS) joint was essential for producing the natural tactile exploration behavior and, thus, for tactile efficiency. For realistic movement patterns, the phase-lead could vary within a limited range of 10-30° only. Tests with artificial movement patterns strongly suggest that this phase sensitivity is not a matter of the frequency composition of the natural movement pattern. Based on our modeling results, we propose that a constant phase difference is coded into the CPG of the antennal motor system and that proprioceptors are acting locally to regulate the joint movement amplitude.

Decoding the mechanisms of gait generation in salamanders by combining neurobiology, modeling and robotics.

Vertebrate animals exhibit impressive locomotor skills. These locomotor skills are due to the complex interactions between the environment, the musculo-skeletal system and the central nervous system, in particular the spinal locomotor circuits. We are interested in decoding these interactions in the salamander, a key animal from an evolutionary point of view. It exhibits both swimming and stepping gaits and is faced with the problem of producing efficient propulsive forces using the same musculo-skeletal system in two environments with significant physical differences in density, viscosity and gravitational load. Yet its nervous system remains comparatively simple. Our approach is based on a combination of neurophysiological experiments, numerical modeling at different levels of abstraction, and robotic validation using an amphibious salamander-like robot. This article reviews the current state of our knowledge on salamander locomotion control, and presents how our approach has allowed us to obtain a first conceptual model of the salamander spinal locomotor networks. The model suggests that the salamander locomotor circuit can be seen as a lamprey-like circuit controlling axial movements of the trunk and tail, extended by specialized oscillatory centers controlling limb movements. The interplay between the two types of circuits determines the mode of locomotion under the influence of sensory feedback and descending drive, with stepping gaits at low drive, and swimming at high drive.

A computational model of visually guided locomotion in lamprey.

This study addresses mechanisms for the generation and selection of visual behaviors in anamniotes. To demonstrate the function of these mechanisms, we have constructed an experimental platform where a simulated animal swims around in a virtual environment containing visually detectable objects. The simulated animal moves as a result of simulated mechanical forces between the water and its body. The undulations of the body are generated by contraction of simulated muscles attached to realistic body components. Muscles are driven by simulated motoneurons within networks of central pattern generators. Reticulospinal neurons, which drive the spinal pattern generators, are in turn driven directly and indirectly by visuomotor centers in the brainstem. The neural networks representing visuomotor centers receive sensory input from a simplified retina. The model also includes major components of the basal ganglia, as these are hypothesized to be key components in behavior selection. We have hypothesized that sensorimotor transformation in tectum and pretectum transforms the place-coded retinal information into rate-coded turning commands in the reticulospinal neurons via a recruitment network mimicking the layered structure of tectal areas. Via engagement of the basal ganglia, the system proves to be capable of selecting among several possible responses, even if exposed to conflicting stimuli. The anatomically based structure of the control system makes it possible to disconnect different neural components, yielding concrete predictions of how animals with corresponding lesions would behave. The model confirms that the neural networks identified in the lamprey are capable of responding appropriately to simple, multiple, and conflicting stimuli.

Sensory feedback plays a significant role in generating walking gait and in gait transition in salamanders: a simulation study.

Here, we investigate the role of sensory feedback in gait generation and transition by using a three-dimensional, neuro-musculo-mechanical model of a salamander with realistic physical parameters. Activation of limb and axial muscles were driven by neural output patterns obtained from a central pattern generator (CPG) which is composed of simulated spiking neurons with adaptation. The CPG consists of a body-CPG and four limb-CPGs that are interconnected via synapses both ipsilaterally and contralaterally. We use the model both with and without sensory modulation and four different combinations of ipsilateral and contralateral coupling between the limb-CPGs. We found that the proprioceptive sensory inputs are essential in obtaining a coordinated lateral sequence walking gait (walking). The sensory feedback includes the signals coming from the stretch receptor like intraspinal neurons located in the girdle regions and the limb stretch receptors residing in the hip and scapula regions of the salamander. On the other hand, walking trot gait (trotting) is more under central (CPG) influence compared to that of the peripheral or sensory feedback. We found that the gait transition from walking to trotting can be induced by increased activity of the descending drive coming from the mesencephalic locomotor region and is helped by the sensory inputs at the hip and scapula regions detecting the late stance phase. More neurophysiological experiments are required to identify the precise type of mechanoreceptors in the salamander and the neural mechanisms mediating the sensory modulation.

A 3D Musculo-Mechanical Model of the Salamander for the Study of Different Gaits and Modes of Locomotion.

Computer simulation has been used to investigate several aspects of locomotion in salamanders. Here we introduce a three-dimensional forward dynamics mechanical model of a salamander, with physically realistic weight and size parameters. Movements of the four limbs and of the trunk and tail are generated by sets of linearly modeled skeletal muscles. In this study, activation of these muscles were driven by prescribed neural output patterns. The model was successfully used to mimic locomotion on level ground and in water. We compare the walking gait where a wave of activity in the axial muscles travels between the girdles, with the trotting gait in simulations using the musculo-mechanical model. In a separate experiment, the model is used to compare different strategies for turning while stepping; either by bending the trunk or by using side-stepping in the front legs. We found that for turning, the use of side-stepping alone or in combination with trunk bending, was more effective than the use of trunk bending alone. We conclude that the musculo-mechanical model described here together with a proper neural controller is useful for neuro-physiological experiments in silico.

System identification of muscle-joint interactions of the cat hind limb during locomotion.

Neurophysiological experiments in walking cats have shown that a number of neural control mechanisms are involved in regulating the movements of the hind legs during locomotion. It is experimentally hard to isolate individual mechanisms without disrupting the natural walking pattern and we therefore introduce a different approach where we use a model to identify what control is necessary to maintain stability in the musculo-skeletal system. We developed a computer simulation model of the cat hind legs in which the movements of each leg are produced by eight limb muscles whose activations follow a centrally generated pattern with no proprioceptive feedback. All linear transfer functions, from each muscle activation to each joint angle, were identified using the response of the joint angle to an impulse in the muscle activation at 65 postures of the leg covering the entire step cycle. We analyzed the sensitivity and stability of each muscle action on the joint angles by studying the gain and pole plots of these transfer functions. We found that the actions of most of the hindlimb muscles display inherent stability during stepping, even without the involvement of any proprioceptive feedback mechanisms, and that those musculo-skeletal systems are acting in a critically damped manner, enabling them to react quickly without unnecessary oscillations. We also found that during the late swing, the activity of the posterior biceps/semitendinosus (PB/ST) muscles causes the joints to be unstable. In addition, vastus lateralis (VL), tibialis anterior (TA) and sartorius (SAT) muscle-joint systems were found to be unstable during the late stance phase, and we conclude that those muscles require neuronal feedback to maintain stable stepping, especially during late swing and late stance phases. Moreover, we could see a clear distinction in the pole distribution (along the step cycle) for the systems related to the ankle joint from that of the other two joints, hip or knee. A similar pattern, i.e., a pattern in which the poles were scattered over the s-plane with no clear clustering according to the phase of the leg position, could be seen in the systems related to soleus (SOL) and TA muscles which would indicate that these muscles depend on neural control mechanisms, which may involve supraspinal structures, over the whole step cycle.