Toward the Intelligent, Safe Exploration of a Biomimetic Underwater Robot: Modeling, Planning, and Control.

Safe, underwater exploration in the ocean is a challenging task due to the complex environment, which often contains areas with dense coral reefs, uneven terrain, or many obstacles. To address this issue, an intelligent underwater exploration framework of a biomimetic robot is proposed in this paper, including an obstacle avoidance model, motion planner, and yaw controller. Firstly, with the aid of the onboard distance sensors in robotic fish, the obstacle detection model is established. On this basis, two types of obstacles, i.e., rectangular and circular, are considered, followed by the obstacle collision model's construction. Secondly, a deep reinforcement learning method is adopted to plan the plane motion, and the performances of different training setups are investigated. Thirdly, a backstepping method is applied to derive the yaw control law, in which a sigmoid function-based transition method is employed to smooth the planning output. Finally, a series of simulations are carried out to verify the effectiveness of the proposed method. The obtained results indicate that the biomimetic robot can not only achieve intelligent motion planning but also accomplish yaw control with obstacle avoidance, offering a valuable solution for underwater operation in the ocean.

A Fish-like Binocular Vision System for Underwater Perception of Robotic Fish.

Biological fish exhibit a remarkably broad-spectrum visual perception capability. Inspired by the eye arrangement of biological fish, we design a fish-like binocular vision system, thereby endowing underwater bionic robots with an exceptionally broad visual perception capacity. Firstly, based on the design principles of binocular visual field overlap and tangency to streamlined shapes, a fish-like vision system is developed for underwater robots, enabling wide-field underwater perception without a waterproof cover. Secondly, addressing the significant distortion and parallax of the vision system, a visual field stitching algorithm is proposed to merge the binocular fields of view and obtain a complete perception image. Thirdly, an orientation alignment method is proposed that draws scales for yaw and pitch angles in the stitched images to provide a reference for the orientation of objects of interest within the field of view. Finally, underwater experiments evaluate the perception capabilities of the fish-like vision system, confirming the effectiveness of the visual field stitching algorithm and the orientation alignment method. The results show that the constructed vision system, when used underwater, achieves a horizontal field of view of 306.56°. The conducted work advances the visual perception capabilities of underwater robots and presents a novel approach to and insight for fish-inspired visual systems.

CylinderTag: An Accurate and Flexible Marker for Cylinder-Shape Objects Pose Estimation Based on Projective Invariants.

High-precision pose estimation based on visual markers has been a thriving research topic in the field of computer vision. However, the suitability of traditional flat markers on curved objects is limited due to the diverse shapes of curved surfaces, which hinders the development of high-precision pose estimation for curved objects. Therefore, this paper proposes a novel visual marker called CylinderTag, which is designed for developable curved surfaces such as cylindrical surfaces. CylinderTag is a cyclic marker that can be firmly attached to objects with a cylindrical shape. Leveraging the manifold assumption, the cross-ratio in projective invariance is utilized for encoding in the direction of zero curvature on the surface. Additionally, to facilitate the usage of CylinderTag, we propose a heuristic search-based marker generator and a high-performance recognizer as well. Moreover, an all-encompassing evaluation of CylinderTag properties is conducted by means of extensive experimentation, covering detection rate, detection speed, dictionary size, localization jitter, and pose estimation accuracy. CylinderTag showcases superior detection performance from varying view angles in comparison to traditional visual markers, accompanied by higher localization accuracy. Furthermore, CylinderTag boasts real-time detection capability and an extensive marker dictionary, offering enhanced versatility and practicality in a wide range of applications. Experimental results demonstrate that the CylinderTag is a highly promising visual marker for use on cylindrical-like surfaces, thus offering important guidance for future research on high-precision visual localization of cylinder-shaped objects. The code is available at: https://github.com/wsakobe/CylinderTag.

Design and Analysis of a Novel Bionic Tensegrity Robotic Fish with a Continuum Body.

Biological fish exhibit remarkable adaptability and exceptional swimming performance through their powerful and flexible bodies. Therefore, designing a continuum flexible body is significantly important for the development of a robotic fish. However, it is still challenging to replicate these functions of a biological body due to the limitations of actuation and material. In this paper, based on a tensegrity structure, we propose a bionic design scheme for a continuum robotic fish body with a property of stiffness variation. Its detailed structures and actuation principles are also presented. A mathematical model was established to analyze the bending characteristics of the tensegrity structure, which demonstrates the feasibility of mimicking the fish-like oscillation propulsion. Additionally, the stiffness variation mechanism is also exhibited experimentally to validate the effectiveness of the designed tensegrity fish body. Finally, a novel bionic robotic fish design scheme is proposed, integrating an electronic module-equipped fish head, a tensegrity body, and a flexible tail with a caudal fin. Subsequently, a prototype was developed. Extensive experiments were conducted to explore how control parameters and stiffness variation influence swimming velocity and turning performance. The obtained results reveal that the oscillation amplitude, frequency, and stiffness variation of the tensegrity robotic fish play crucial roles in swimming motions. With the stiffness variation, the developed tensegrity robotic fish achieves a maximum swimming velocity of 295 mm/s (0.84 body length per second, BL/s). Moreover, the bionic tensegrity robotic fish also performs a steering motion with a minimum turning radius of 230 mm (0.68 BL) and an angular velocity of 46.6°/s. The conducted studies will shed light on the novel design of a continuum robotic fish equipped with stiffness variation mechanisms.

Target-Following Control of a Biomimetic Autonomous System Based on Predictive Reinforcement Learning.

Biological fish often swim in a schooling manner, the mechanism of which comes from the fact that these schooling movements can improve the fishes' hydrodynamic efficiency. Inspired by this phenomenon, a target-following control framework for a biomimetic autonomous system is proposed in this paper. Firstly, a following motion model is established based on the mechanism of fish schooling swimming, in which the follower robotic fish keeps a certain distance and orientation from the leader robotic fish. Second, by incorporating a predictive concept into reinforcement learning, a predictive deep deterministic policy gradient-following controller is provided with the normalized state space, action space, reward, and prediction design. It can avoid overshoot to a certain extent. A nonlinear model predictive controller is designed and can be selected for the follower robotic fish, together with the predictive reinforcement learning. Finally, extensive simulations are conducted, including the fix point and dynamic target following for single robotic fish, as well as cooperative following with the leader robotic fish. The obtained results indicate the effectiveness of the proposed methods, providing a valuable sight for the cooperative control of underwater robots to explore the ocean.

A Circular Formation Method for Biomimetic Robotic Fish Inspired by Fish Milling.

Circular motion phenomena, akin to fish milling, are prevalent within the animal kingdom. This paper delineates two fundamental mechanisms underlying such occurrences: forward following and circular topological communication. Leveraging these pivotal concepts, we present a multi-agent formation circular model based on a second-order integrator. This model engenders the attainment of homogeneous intelligence convergence along the circumferential trajectory. The convergence characteristics are intricately linked to the number of agents and the model parameters. Consequently, we propose positive and negative solutions for ascertaining the convergent circle property and model parameters. Furthermore, by integrating our proposed formation control methodology with a robotic fish dynamics model, we have successfully implemented simulations and experiments, demonstrating the circular formation of multiple biomimetic robotic fish. This study provides a mathematical explication for the circular motion observed in animal groups and introduces a novel approach to achieving circular formation in multiple robots inspired by biological phenomena.

Performance Optimization for Bionic Robotic Dolphin with Active Variable Stiffness Control.

Aquatic animals such as fish and cetaceans can actively modulate their body stiffness with muscle to achieve excellent swimming performance under different situations. However, it is still challenging for a robotic swimmer with bionic propulsion mode to dynamically adjust its body stiffness to improve the swimming speed due to the difficulties in designing an effective stiffness adjustment structure. In this paper, based on the special torque mode of a motor, we propose an active variable stiffness control method for a robotic dolphin to pursue better swimming speed. Different from a variable stiffness structure design, a torque control strategy for the caudal motor is employed to imitate the physical property of a torsion spring to act as the variable stiffness component. In addition, we also establish a dynamic model with the Lagrangian method to explore the variable stiffness mechanism. Extensive experiments have validated the dynamic model, and then the relationships between frequency and stiffness on swimming performance are presented. More importantly, through integrating the dynamic model and torque actuation mode-based variable stiffness mechanism, the online performance optimization scheme can be easily realized, providing valuable guidance in coordinating system parameters. Finally, experiments have demonstrated the stiffness adjustment capability of the caudal joint, validating the effectiveness of the proposed control method. The results also reveal that stiffness plays an essential role in swimming motion, and the active stiffness adjustment can significantly contribute to performance improvement in both speed and efficiency. Namely, with the adjustment of stiffness, the maximum speed of our robotic dolphin achieves up to 1.12 body length per second (BL/s) at 2.88 Hz increasing by 0.44 BL/s. Additionally, the efficiency is also improved by 37%. The conducted works will offer some new insights into the stiffness adjustment of robotic swimmers for better swimming performance.

HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration.

Robust vision restoration of underwater images remains a challenge. Owing to the lack of well-matched underwater and in-air images, unsupervised methods based on the cyclic generative adversarial framework have been widely investigated in recent years. However, when using an end-to-end unsupervised approach with only unpaired image data, mode collapse could occur, and the color correction of the restored images is usually poor. In this paper, we propose a data- and physics-driven unsupervised architecture to perform underwater image restoration from unpaired underwater and in-air images. For effective color correction and quality enhancement, an underwater image degeneration model must be explicitly constructed based on the optically unambiguous physics law. Thus, we employ the Jaffe-McGlamery degeneration theory to design a generator and use neural networks to model the process of underwater visual degeneration. Furthermore, we impose physical constraints on the scene depth and degeneration factors for backscattering estimation to avoid the vanishing gradient problem during the training of the hybrid physical-neural model. Experimental results show that the proposed method can be used to perform high-quality restoration of unconstrained underwater images without supervision. On multiple benchmarks, the proposed method outperforms several state-of-the-art supervised and unsupervised approaches. We demonstrate that our method yields encouraging results in real-world applications.

A Torque Control Strategy for a Robotic Dolphin Platform Based on Angle of Attack Feedback.

Biological fish can always sense the state of water flow and regulate the angle of attack in time, so as to maintain the highest movement efficiency during periodic flapping. The biological adjustment of the caudal fin's angle of attack (AoA) depends on the contraction/relaxation of the tail muscles, accompanying the variation in tail stiffness. During an interaction with external fluid, it helps to maintain the optimal angle of attack during movement, to improve the propulsion performance. Inspired by this, this paper proposes a tail joint motion control scheme based on AoA feedback for the high-speed swimming of bionic dolphins. Firstly, the kinematic characteristics of the designed robot dolphin are analyzed, and the hardware basis is clarified. Second, aiming at the deficiency of the tail motor, which cannot effectively cooperate with the waist joint motor during high-frequency movement, a compensation model for the friction force and latex skin-restoring force is designed, and a joint angle control algorithm based on fuzzy inference is proposed to realize the tracking of the desired joint angle for the tail joint in torque mode. In addition, a tail joint closed-loop control scheme based on angle of attack feedback is proposed to improve the motion performance. Finally, experiments verify the effectiveness of the proposed motion control scheme.

LQR Control and Optimization for Trajectory Tracking of Biomimetic Robotic Fish Based on Unreal Engine.

A realistic and visible dynamic simulation platform can significantly facilitate research on underwater robots. This paper uses the Unreal Engine to generate a scene that resembles real ocean environments, before building a visual dynamic simulation platform in conjunction with the Air-Sim system. On this basis, the trajectory tracking of a biomimetic robotic fish is simulated and assessed. More specifically, we propose a particle swarm optimization algorithm-based control strategy to optimize the discrete linear quadratic regulator controller for the trajectory tracking problem, as well as tracking and controlling discrete trajectories with misaligned time series through introducing a dynamic time warping algorithm. Simulation analyses of the biomimetic robotic fish following a straight line, a circular curve without mutation, and a four-leaf clover curve with mutation are carried out. The obtained results verify the feasibility and effectiveness of the proposed control strategy.

A Liquid Metal Temperature Detection System Based on Multi-Node Sapphire Fiber Sensor.

In order to accurately detect the temperature of molten aluminum and overcome the adverse influence of high temperature and corrosiveness on the sensing results, a temperature detection system based on a multi-node sapphire fiber sensor was proposed and developed. Through the structural parameter design of the fiber sensor, the scheme of utilizing the 0.7 mm diameter fiber and 0.5 mm groove was formulated. Simulation and analysis were carried out to determine the ultrasonic response distribution of the signal passing through the whole fiber sensor. The results indicate that the system is capable of distinguishing test signals from various positions and temperatures. Following the completion of the static calibration, the temperature of the molten aluminum was observed in real-time, and the data of the temperature measurements conducted at the two groove locations were compared. According to the obtained results, the test accuracy was greater than 1 degree Celsius and the temperature test stability was good, laying a solid foundation for the potential development of temperature measurement devices.

A Survey on Reinforcement Learning Methods in Bionic Underwater Robots.

Bionic robots possess inherent advantages for underwater operations, and research on motion control and intelligent decision making has expanded their application scope. In recent years, the application of reinforcement learning algorithms in the field of bionic underwater robots has gained considerable attention, and continues to grow. In this paper, we present a comprehensive survey of the accomplishments of reinforcement learning algorithms in the field of bionic underwater robots. Firstly, we classify existing reinforcement learning methods and introduce control tasks and decision making tasks based on the composition of bionic underwater robots. We further discuss the advantages and challenges of reinforcement learning for bionic robots in underwater environments. Secondly, we review the establishment of existing reinforcement learning algorithms for bionic underwater robots from different task perspectives. Thirdly, we explore the existing training and deployment solutions of reinforcement learning algorithms for bionic underwater robots, focusing on the challenges posed by complex underwater environments and underactuated bionic robots. Finally, the limitations and future development directions of reinforcement learning in the field of bionic underwater robots are discussed. This survey provides a foundation for exploring reinforcement learning control and decision making methods for bionic underwater robots, and provides insights for future research.

Platform development and gliding optimization of a robotic flying fish with morphing pectoral fins.

The aquatic-aerial robot with the free interface crossing can enhance adaptability in complex aquatic environments. However, its design is extremely challenging for the striking discrepancies in propulsion principles. The flying fish in nature exhibits remarkable multi-modal cross-domain locomotion capability, such as high-maneuvers swimming, agile water-air crossing, and long-distance gliding, providing extensive inspiration. In this paper, we present a unique aquatic-aerial robotic flying fish with powerful propulsion and a pair of morphing wing-like pectoral fins to realize cross-domain motion. Furthermore, to explore the gliding mechanism of flying fish, a dynamic model with a morphing structure of pectoral fins is established, and a double deep Q-network-based control strategy is proposed to optimize the gliding distance. Finally, experiments were conducted to analyze the locomotion of the robotic flying fish. The results suggest that the robotic flying fish can successfully perform the 'fish leaping and wing spreading' cross-domain locomotion with an exiting speed of 1.55 m s-1(5.9 body lengths per second, BL/s) and a crossing time of 0.233 s indicating its great potential in cross-domain. Simulation results have validated the effectiveness of the proposed control strategy and indicated that the dynamical adjustment of morphing pectoral fins contributes to improving the gliding distance. The maximum gliding distance has increased by 7.2%. This study will offer some significant insights into the system design and performance optimization of aquatic-aerial robots.

Proactivity of fish and leadership of self-propelled robotic fish during interaction.

Fish interacting with biomimetic robotic fish is beneficial for animal behavior research, particularly in the study of collective behavior. Compared with passive-dragging robotic fish, self-propelled robotic fish floats in water, and its movement matches the flow field formed by the caudal fin oscillation, leading to more realistic interaction with animals. In this paper, we propose a self-propelled koi-mimicking robotic fish entity, develop a system for robotic fish and koi fish interaction, and conduct extensive experiments on quantity variation and parameter variation. The results showed that fish exhibited significantly lower proactivity when alone, and the most proactive case is one robotic fish interacting with two real fish. The experiments on parameter variation indicated that fish may respond more proactivity to robotic fish that swim with high frequency and low amplitude, but may also move together with high-frequency and high-amplitude swimming robotic fish. These findings could provide insights into fish collective behavior, guide the design of further fish-robot interaction experiments, and suggest directions for future improvements in goal-oriented robotic fish platforms.

Development and 3-D Path-Following Control of an Agile Robotic Manta With Flexible Pectoral Fins.

The broad and powerful pectoral fins of manta rays are crucial to their efficient and maneuverable swimming. However, very little is currently known about the pectoral-fin-driven 3-D locomotion of manta-inspired robots. This study is focused on the development and 3-D path-following control of an agile robotic manta. First, a novel robotic manta with 3-D mobility is constructed, of which the distinctive pectoral fins provide the only propulsion. Specifically, the unique pitching mechanism is detailed in which the time-coupled coordination movement of the pectoral fins is applied. Second, based on a 6-axis force measuring platform, the propulsion characteristics of the flexible pectoral fins are analyzed. Then, the force-data-driven 3-D dynamic model is further established. Third, a control scheme combined with a line-of-sight (LOS) guidance system and a sliding-mode fuzzy controller is conceived, addressing the 3-D path-following task. Finally, various simulated and aquatic experiments are conducted, demonstrating the superior performance of our prototype and the effectiveness of the proposed path-following scheme. This study will hopefully generate fresh insights into the updated design and control of agile bioinspired robots performing underwater tasks in dynamic environments.

Multi-UUV Maneuvering Counter-Game for Dynamic Target Scenario Based on Fractional-Order Recurrent Neural Network.

In this article, a multi-underwater unmanned vehicle (UUV) maneuvering decision-making algorithm is proposed for a counter-game with a dynamic target scenario. The game is modeled with interval-valued intuitionistic fuzzy rules, and an optimal maneuvering strategy is realized using a fractional-order recurrent neural network (RNN). First, underwater environments with weak connectivity, underwater noise, and dynamic uncertainties are analyzed and incorporated into the interval-valued intuitionistic fuzzy set. Then, the maneuvering decision-making model and the expected return of the multi-UUV countermeasure are designed based on the interval-valued intuitionistic fuzzy rules. Subsequently, to optimize the counter-game maneuvering strategy, a fractional-order RNN is formulated based on the Karush-Kuhn-Tucker optimality conditions. In addition, the existence and uniqueness of the optimal maneuvering solutions as well as the stability of the equilibrium point are discussed. Finally, simulation and experimental results are compared to determine the effectiveness of the proposed algorithm. The influence of the fractional order on the convergence rate and optimization error of the proposed algorithm is also minutely examined.

An Online 3D Modeling Method for Pose Measurement under Uncertain Dynamic Occlusion Based on Binocular Camera.

3D modeling plays a significant role in many industrial applications that require geometry information for pose measurements, such as grasping, spraying, etc. Due to random pose changes in the workpieces on the production line, demand for online 3D modeling has increased and many researchers have focused on it. However, online 3D modeling has not been entirely determined due to the occlusion of uncertain dynamic objects that disturb the modeling process. In this study, we propose an online 3D modeling method under uncertain dynamic occlusion based on a binocular camera. Firstly, focusing on uncertain dynamic objects, a novel dynamic object segmentation method based on motion consistency constraints is proposed, which achieves segmentation by random sampling and poses hypotheses clustering without any prior knowledge about objects. Then, in order to better register the incomplete point cloud of each frame, an optimization method based on local constraints of overlapping view regions and a global loop closure is introduced. It establishes constraints in covisibility regions between adjacent frames to optimize the registration of each frame, and it also establishes them between the global closed-loop frames to jointly optimize the entire 3D model. Finally, a confirmatory experimental workspace is designed and built to verify and evaluate our method. Our method achieves online 3D modeling under uncertain dynamic occlusion and acquires an entire 3D model. The pose measurement results further reflect the effectiveness.

Quantifying the Leaping Motion Using a Self-Propelled Bionic Robotic Dolphin Platform.

Kinematic analysis of leaping motions can provide meaningful insights into unraveling the efficient and agile propulsive mechanisms in dolphin swimming. However, undisturbed kinematic examination of live dolphins has been very scarce due to the restriction of close-up biological observation with a motion capture system. The main objective of this study is to quantify the leaping motion of a self-propelled bionic robotic dolphin using a combined numerical and experimental method. More specifically, a dynamic model was established for the hydrodynamic analysis of a changeable submerged portion, and experimental data were then employed to identify hydrodynamic parameters and validate the effectiveness. The effects of wave-making resistance were explored, indicating that there is a varying nonlinear relationship between power and speed at different depths. In addition, the wave-making resistance can be reduced significantly when swimming at a certain depth, which leads to a higher speed and less consumed power. Quantitative estimation of leaping motion is carried out, and the results suggest that with increase of the exiting velocity and angle, the maximum height of the center of mass (CM) increases as well; furthermore, a small exiting angle usually requires a much larger exiting velocity to achieve a complete exiting motion. These findings provide implications for optimizing motion performance, which is an integral part of underwater operations in complex aquatic environments.

HydraMarker: Efficient, Flexible, and Multifold Marker Field Generation.

An n-order marker field is a special binary matrix whose n×n subregions are all distinct from each other in four orientations. It is commonly used to guide the composing process of position-sensing markers, which can be detected and identified in a camera image with very limited scope or severe visibility problems. Despite the advantages, position-sensing markers are rare and overlooked because generating marker fields is difficult. In this article, we broaden the definition of marker field, making it more powerful and flexible. Then, we propose bWFC (binary wave function collapse) and its high-speed version, fast-bWFC, to solve the generation problem. The methods are packaged into an open-sourced toolkit named HydraMarker, with which, users not only can generate marker fields on laptops within a short period of time, but also can highly customize them: preset values; fields and subregions in any shape; multifold local uniqueness. Comparative results indicate that the proposed method has superior efficiency, quality, and capability. It makes marker field generation accessible to common marker designers, opening up more possibilities for fiducial markers.

Decoupled Metric Network for Single-Stage Few-Shot Object Detection.

Within the last few years, great efforts have been made to study few-shot learning. Although general object detection is advancing at a rapid pace, few-shot detection remains a very challenging problem. In this work, we propose a novel decoupled metric network (DMNet) for single-stage few-shot object detection. We design a decoupled representation transformation (DRT) and an image-level distance metric learning (IDML) to solve the few-shot detection problem. The DRT can eliminate the adverse effect of handcrafted prior knowledge by predicting objectness and anchor shape. Meanwhile, to alleviate the problem of representation disagreement between classification and location (i.e., translational invariance versus translational variance), the DRT adopts a decoupled manner to generate adaptive representations so that the model is easier to learn from only a few training data. As for a few-shot classification in the detection task, we design an IDML tailored to enhance the generalization ability. This module can perform metric learning for the whole visual feature, so it can be more efficient than traditional DML due to the merit of parallel inference for multiobjects. Based on the DRT and IDML, our DMNet efficiently realizes a novel paradigm for few-shot detection, called single-stage metric detection. Experiments are conducted on the PASCAL VOC dataset and the MS COCO dataset. As a result, our method achieves state-of-the-art performance in few-shot object detection. The codes are available at https://github.com/yrqs/DMNet.