Tracking Control of Heterogeneous Multiagent Systems With Intrinsic Nonlinear Dynamics in Noisy and Time-Delayed Environments.

This article investigates the tracking control problem of heterogeneous multiagent systems (MASs) with intrinsic nonlinear dynamics in noisy and time-delayed environments. First, a stability criterion for nonlinear stochastic delay systems with multiplicative noise and time-varying delay is proposed by applying the appropriate Lyapunov-Krasovskii functional. Then, based on the proposed stability criterion, sufficient conditions are derived for mean square (m.s.) and almost sure (a.s.) tracking of heterogeneous MASs with intrinsic nonlinear dynamics. Afterward, the above sufficient conditions further degenerate to integrator heterogeneous MASs. In particular, when the time-delay vanishes, the explicit conditions are obtained for the integrator heterogeneous MASs in the form of scalar inequalities, which can intuitively reflect the relationship between noise intensity and control gains. Finally, simulation results validate the effectiveness of the proposed control protocol.

Finite-Time Robust Distributed Estimate for Nonlinear Systems With Heterogeneous Sensors.

This article proposes a finite-time distributed state estimation (DSE) algorithm for discrete-time stochastic nonlinear systems with heterogeneous sensors. Considering the network with heterogeneous sensors, the distributed estimate framework is designed by three phases, namely, priori prediction, measurement update, and consensus fusion. To obtain the accurate priori prediction results, the interactive multiple model (IMM) method is adopted to calculate the priori state value in the priori prediction phase. By introducing the measurement probability matrix, a novel heterogeneous measurement information fusion algorithm is designed. Then the measurement information of each sensor is used to update the priori prediction estimates to calculate the estimate results in the measurement update phase. Based on the consensus method, the estimate results of each sensor are fused with consensus weight to calculate the distributed state estimates of nonlinear systems in the consensus fusion phase. Besides, with finite consensus fusion steps, the bounds of the proposed distributed estimate algorithm are proved to be existed. Finally, distributed state estimate simulation example for nonlinear system is set to validate the performance.

Finite-Time Time-Varying Formation Tracking for Heterogeneous Nonlinear Multiagent Systems Using Adaptive Output Regulation.

The finite-time output time-varying formation tracking (TVFT) problem for heterogeneous nonlinear multiagent system (MAS) is investigated in this article, where the dynamics of the agents can be nonidentical, and leader's input is unknown. The target of this article is that the outputs of followers need to track leader's output and realize the desired formation in finite time. First, for removing the assumption that all agents are required to know the information of leader's system matrices and the upper boundary of its unknown control input in previous studies, a kind of finite-time observer is constructed by exploiting the neighboring information, which can estimate not only the leader's state and system matrices but also can compensate for the effects of unknown input. On the basis of the developed finite-time observers and adaptive output regulation method, a novel finite-time distributed output TVFT controller is proposed with the help of the technique of coordinate transformation by introducing an extra variable, which removes the assumption that the generalized inverse matrix of follows' input matrix needs to be found in the existing results. By means of the Lyapunov and finite-time stability theory, it is proven that the expected finite-time output TVFT can be realized by the considered heterogeneous nonlinear MASs within a finite time. Finally, simulation results demonstrate the efficacy of the proposed approach.

Distributed Asynchronous Constrained Output Formation Optimal Tracking for Multiagent Systems With Intermittent Communications.

Distributed output formation optimal tracking problems for multiagent systems over time-varying topologies with asynchronous and intermittent communications are investigated. Each agent collaboratively computes and tracks the optimal output formation reference that minimizes a global objective function formed by summing local objective functions. Simultaneously, this reference satisfies global constraints composed of local nonlinear inequality constraints and local closed convex set constraints. An asynchronous distributed estimator-based tracking control protocol is designed utilizing the constrained stochastic subgradient random projection method and the Lyapunov stability theory. Sufficient conditions for asymptotic convergence are given. It is revealed that the states of agents with constraints under asynchronous and intermittent communications converge asymptotically to the optimal reference signal using only neighboring information within the predefined formation. Finally, a numerical example is provided to validate the theoretical results.

Resilient Time-Varying Formation Tracking Control for General Linear Multiagent Systems With a Nonautonomous Leader and Adversarial Followers.

This article is concerned with resilient formation tracking problems for general linear multiagent systems, where the leader's control input is unavailable to all the followers and partial followers' behaviors are malicious due to the node attacks. Despite the presence of the nonautonomous leader and the adversarial followers, the remaining benign followers are still expected to track the leader's trajectory with the prescribed time-varying formation. To this end, a resilient scheme comprising an attack detection and isolation strategy and a formation tracking protocol is proposed. The detection strategy enables every benign follower to identify its adversarial neighbors with two-hop communication information, as long as the underlying topology meets given conditions. Then, the detected adversarial agents are directly removed to avoid the spread of their influence, which induces a new problem called node loss. To accommodate possible node loss events, the designed tracking protocol is independent of certain global knowledge, and its convergence is demonstrated by means of the impulsive Lyapunov functions. Finally, the proposed resilient scheme is verified by two simulation examples.

Privacy-preserving push-sum distributed cubature information filter for nonlinear target tracking with switching directed topologies.

To address the data security issue of distributed state estimation, this paper proposes a novel consensus-based cubature information filtering algorithm for sensitive nonlinear target tracking under restricted communication. Through a privacy-preserving approach via state decomposition, the algorithm can protect the privacy of local information from adversaries without sacrificing global estimation accuracy. Based on the push-sum consensus, the distributed approach is further extended to switching directed topologies, which is more feasible for tracking with communication constraints. Our method's average convergence, privacy preservation, and stability are theoretically proved. Finally, simulations are conducted to evaluate the algorithm's performance on security, accuracy, and robustness.

Distributed output formation tracking control of heterogeneous multi-agent systems using reinforcement learning.

This paper studies the distributed time-varying output formation tracking problem for heterogeneous multi-agent systems with both diverse dimensions and parameters. The output of each follower is supposed to track that of the virtual leader while accomplishing a time-varying formation configuration. First, a distributed trajectory generator is proposed based on neighboring interactions to reconstitute the state of virtual leader and provide expected trajectories with the formation incorporated. Second, an optimal tracking controller is designed by the model-free reinforcement learning technique using online off-policy data instead of requiring any knowledge of the followers' dynamics. Stabilities of the learning process and resulting controller are analyzed while solutions to the output regulator equations are equivalently obtained. Third, a compensational input is designed for each follower based on previous learning results and a derived feasibility condition. It is proved that the output formation tracking error converges to zero asymptotically with the biases to cost functions being restricted arbitrarily small. Finally, numerical simulations verify the proposed learning and control scheme.

Measurement based dimension descent association algorithm for OTHR multi-detection multi-target tracking.

The problem of multi-detection multi-target tracking (MDMTT) using over-the-horizon radar in dense clutter environment is studied in this paper. The biggest challenge of MDMTT is the 3-dimensional multipath data association among measurements, detection models and targets. In particular, a lot of clutter measurements are generated in dense clutter environment, which increase the computational burden of 3-dimensional multipath data association greatly. A measurement based dimension descent association (DDA) algorithm is proposed to solve the 3-dimensional multipath data association, which decomposes the 3-dimensional multipath data association into two 2-dimensional data associations. The proposed algorithm can reduce the computational burden compared with the optimal 3-dimensional multipath data association and the computational complexity is analyzed. Besides, a time extension method is designed to detect the new-born targets that appear in the tracking scene, which is based on the sequential measurements. The convergence of the proposed measurement based DDA algorithm is analyzed. The estimation error can convergence to 0 as the number of Gaussian mixtures tends to infinity. The effectiveness and rapidity of the measurement based DDA algorithm are demonstrated by the comparative simulation with the previously proposed algorithms.

Distributed Fault-Tolerant Formation Tracking Control for Multiagent Systems With Multiple Leaders and Constrained Actuators.

The distributed formation tracking control problem with multiple leaders under actuator faults and constraints is investigated in this article. All followers in the multiagent system should achieve a desired time-varying formation and track the convex combination of multiple leaders. To accomplish the control task, an active reconfigurable control scheme is proposed using the local information between agents, as well as the fault values of individuals provided by fault estimation observers. Combining with the Lyapunov stability theorem and the property of the Laplacian matrix, the control gains are calculated using the adaptive technique with a formation tracking feasibility condition. The original reconfigurable protocol is modified by utilizing anti-windup compensators to against saturation phenomenons (both magnitude and rate) in actuators. The simulation results validate that the presented scheme can address the faults as well as the actuator saturation.

Practical Output Containment of Heterogeneous Nonlinear Multiagent Systems Under External Disturbances.

The practical output containment problem for heterogeneous nonlinear multiagent systems under external disturbances generated by an exosystem is investigated in this article. It is required that the outputs of followers converge to the predefined convex combination of leaders' outputs. One of the major challenges in solving such a problem lies in dealing with the coupling among different nonlinearities, state dimensions, and system matrices of heterogeneous agents. To overcome the aforementioned challenge, a distributed observer-based control protocol is developed and employed. First, an adaptive state observer for estimating the states of all the leaders is constructed based on the neighboring interactions. Second, two new classes of observers are constructed for each follower exploiting the output information of the follower, in which the adaptive neural networks (NNs)-based approximation is exploited to compensate for the unknown nonlinearity in the followers' dynamics. A practical output containment control protocol is then generated by the proposed observers, where the control parameters are determined by an algorithm including two steps. Furthermore, with the help of the Lyapunov stability theory and the output regulation method, the practical output containment criteria for the considered closed-loop system under the influences of external disturbances are derived on the basis of the presented control protocol. Finally, the derived theoretical results are illustrated by a simulation example.

Neuroadaptive Output Formation Tracking for Heterogeneous Nonlinear Multiagent Systems With Multiple Nonidentical Leaders.

This article investigates the practical time-varying output formation tracking (TVOFT) problem for heterogeneous nonlinear multiagent systems (MASs) having multiple leaders, where agents herein could have heterogeneous dynamics and interact with each other under event-triggered communications. It is required that the outputs of followers not only track the predefined convex combination of multiple leaders but also achieve the desired time-varying formation simultaneously. The existing works on formation tracking problems for MASs with multiple leaders depend on the assumption that each follower is a well-informed or uninformed follower, where the well-informed follower is required to have all the leaders as its neighbor. To remove the limitation, a fully distributed observer-based formation tracking control protocol is developed and employed. First, an adaptive state observer with an edge-based event-triggered mechanism for estimating the states of multiple leaders is proposed based on the neighboring interactions, which eliminates the unexpected Zeno behavior. Second, a novel observer is constructed for each follower by exploiting the output information of the follower, in which the adaptive neural network (NN)-based approximation is exploited to compensate for the unknown nonlinearity. A practical TVOFT control protocol is then generated by the proposed observers, where the parameters are determined by an algorithm including five steps. With the help of Lyapunov stability theory and output regulation method, a practical TVOFT criterion for the considered closed-loop system is derived. Finally, the effectiveness of the proposed control scheme is illustrated by a numerical example.

Fully Data-Driven Robust Output Formation Tracking Control for Heterogeneous Multiagent System With Multiple Leaders and Actuator Faults.

This article investigates a fully data-driven method to solve the robust output formation tracking control problem for the multiagent system (MAS) under actuator faults. The outputs of the followers are controlled to track those of multiple leaders with respect to a convex point while achieving an expected time-varying formation. To obviate the requirement of various system prior knowledge in typical MAS control, a hierarchical frame is developed with three learning and control stages using the online measured data. First, a distributed adaptive observer is designed to coordinate the state convex of multiple leaders while estimating unknown dynamics. The adaptive mechanism relaxes the demand for global topology. Second, by collecting and reusing the online system data, an off-policy reinforcement learning (RL) method is proposed in a continuous form to acquire nominal feedback gains from partial observations of the followers. Essential system models are learned along with the RL process, while solutions to the output regulation equations are implicitly obtained. Third, a comprehensive robust controller is further presented based on the previous learning results. To address the actuator faults with efficiency loss and bias, the adaptive neural networks and robust compensations are utilized in a model-free manner. The output formation tracking is achieved under a derived feasibility condition while stabilities of the learning and control methods are analyzed. Finally, simulation results demonstrate the validity of this fully data-driven control frame.

Time-Varying Group Formation-Containment Tracking Control for General Linear Multiagent Systems With Unknown Inputs.

Time-varying group formation-containment tracking problems for general linear multiagent systems with unknown control input are investigated. Agents are classified into tracking leaders, formation leaders, and followers and assigned in groups. Tracking leaders with unknown control inputs provide unpredictable trajectories as macroscopic moving references. Formation leaders accomplish desired subformations while following the trails of tracking leaders. At the same time, followers converge into different convex hulls spanned by formation leaders. First, formation-containment tracking protocols are designed with neighboring relative information and effects of unknown input of tracking leaders. Then, the design of group division is analyzed by adjusting the properties in Laplacian matrices, which represent interaction relationships. An algorithm to determine the parameters in control protocols is proposed, and the formation tracking feasible constraint is presented. Next, it is proved that the general linear multiagent system can achieve time-varying group formation-containment control effectively with errors uniformly asymptotically converging to zero under designed protocols. Finally, a numerical simulation is given to verify the effectiveness of obtained theoretical results.

Fully Adaptive Practical Time-Varying Output Formation Tracking for High-Order Nonlinear Stochastic Multiagent System With Multiple Leaders.

Fully adaptive practical time-varying output formation tracking issues of high-order nonlinear stochastic multiagent systems with multiple leaders are researched, where the adaptive fuzzy-logic system (FLS) is introduced for estimating the mismatched integrated uncertain items. Distinctive with former results, stochastic noise is considered in the dynamics, and the followers are required for achieving the time-varying output formation tracking in probability of the convex combination of the leaders' outputs. First, a fully adaptive practical time-varying output formation tracking protocol is put forward, which only utilizes the neighboring relative information, and the global interaction topology information is not used. Besides, the designed protocol employs the adaptive FLSs to estimate the mismatched uncertainties of the followers and the leaders, and the uncertain boundary functions of the stochastic noise. Then, the design process of control protocol and parameter adaptive update law is summarized within four steps in an algorithm. Third, the stability and the properties of the proposed protocol and algorithm are analyzed by employing the Lyapunov theories and stochastic stability theories. Finally, numerical simulation results illustrate the effectiveness of achieved protocol and algorithm.

Distributed finite time cubature information filtering with unknown correlated measurement noises.

This paper addresses the distributed state estimation problem for a class of discrete nonlinear system over sensor networks subject to unknown correlated measurement noises. Firstly, under the condition of network connectivity, a novel communication protocol is developed to ensure every sensor node can gather the information distributed throughout the network within finite communication time. Then a fully distributed estimator is designed by periodically fusing the local information and neighbor's information according to the covariance intersection fusion strategy. Theoretically, it is proved that the distributed estimator in each sensor node is stable with the exponentially bounded estimation error in mean square. Finally, some numerous simulations are performed to illustrate the practical effectiveness and superiority of the proposed state estimator.

Practical time-varying output formation tracking for high-order nonlinear strict-feedback multi-agent systems with input saturation.

Practical time-varying output formation tracking (PTVOFT) analysis and design task of high-order nonlinear strict-feedback multi-agent systems (MASs) containing control saturation is processed, in which PTVOF error is confined to a narrow range. Distinct with former achievements, agents' model characteristics are high-order nonlinear strict-feedback form with mismatched uncertain nonlinearities and control saturation constraints while multi-follower system is required for achieving PTVOFT for a maneuvering leader. Firstly, hierarchical distributed extended state observer (DESO) is put forward which only employs information between adjacent individuals for approximating mismatched nonlinearities of followers together with mismatched nonlinearities of the leader. Secondly, the practical time-varying output formation tracking protocol can be raised. Backstepping techniques are applied in design procedures to provide primary variables for each control loop, where hierarchical DESOs are utilized for dealing with comprehensive uncertainties. Distributed auxiliary systems are designed for providing compensating signals to achieve the input saturation. Then, the design processes of PTVOFT protocol and hierarchical DESOs are summarized within three steps in an algorithm. Thirdly, the stability and the properties of the proposed protocol and algorithm are analyzed through employing graph theories and Lyapunov theories. Finally, numerical simulation results illustrate the effectiveness of achieved protocol and algorithm.

Adaptive fault-tolerant time-varying formation tracking for multi-agent systems under actuator failure and input saturation.

This paper studies the time-varying formation tracking problem for general linear multi-agent systems with multiple leaders in the presence of both actuator failure and input saturation. The followers are required to uniquely determine and track the convex combination of the states of leaders, while maintaining a predefined time-varying formation. A hyperbolic tangent function is firstly introduced to modify the actuator model with input saturation constraint. Then, an augmented plant for dynamics of each follower is constructed to derive the control protocol by exploiting the dynamic surface control technique. The proposed control protocol deals with faults of bias and unknown bounded loss of effectiveness by means of adaptive fault-tolerant strategies, while a formation feasible condition should be satisfied. With the control signal generated by the augmented plant, the time-varying formation error is proved to be semi-globally uniformly bounded under the faults and input saturation, based on standard Lyapunov theory. Finally, a numerical simulation is implemented to demonstrate the effectiveness of the proposed algorithm.

Time-Varying Formation Tracking for UAV Swarm Systems With Switching Directed Topologies.

Time-varying formation tracking (TVFT) control problems for a team of unmanned aerial vehicles (UAVs) with switching and directed interaction topologies are investigated, where the follower UAVs realize a given time-varying formation while tracking the leader UAV. A TVFT control protocol is firstly constructed utilizing local neighboring information, where the information of the leader UAV is only available to partial followers and the neighborhood can be switching. An algorithm composed of four steps is provided to design the TVFT protocol. It is proved that the UAV swarm system can realize the TVFT using the designed protocol if the dwell time for the switching directed topologies is larger than a fixed threshold and the TVFT feasibility condition is satisfied. Based on the ultrawideband positioning technology, a quadrotor UAV formation control platform with four quadrotor UAVs is given. The obtained theoretical results are applied to solve the target enclosing problems of the UAV swarm systems. A flying experiment for three follower quadrotor UAVs to enclose a leader quadrotor UAV is carried out to verify the effectiveness of the presented results.

Practical Time-Varying Formation Tracking for Second-Order Nonlinear Multiagent Systems With Multiple Leaders Using Adaptive Neural Networks.

Practical time-varying formation tracking problems for second-order nonlinear multiagent systems with multiple leaders are investigated using adaptive neural networks (NNs), where the time-varying formation tracking error caused by time-varying external disturbances can be arbitrarily small. Different from the previous work, there exists a predefined time-varying formation formed by the states of the followers and the formation tracks the convex combination of the states of the leaders with unknown control inputs. Besides, the dynamics of each agent has both matched/mismatched heterogeneous nonlinearities and disturbances simultaneously. First, a practical time-varying formation tracking protocol using adaptive NNs is proposed, which is constructed using only local neighboring information. The proposed control protocol can process not only the matched/mismatched heterogeneous nonlinearities and disturbances, but also the unknown control inputs of the leaders. Second, an algorithm with three steps is introduced to design the practical formation tracking protocol, where the parameters of the protocol are determined, and the practical time-varying formation tracking feasibility condition is given. Third, the stability of the closed-loop multiagent system is proven by using the Lyapunov theory. Finally, a simulation example is showed to illustrate the effectiveness of the obtained theoretical results.

Distributed fault-tolerant time-varying formation control for high-order linear multi-agent systems with actuator failures.

This paper investigates the fault-tolerant time-varying formation control problems for high-order linear multi-agent systems in the presence of actuator failures. Firstly, a fully distributed formation control protocol is presented to compensate for the influences of both bias fault and loss of effectiveness fault. Using the adaptive online updating strategies, no global knowledge about the communication topology is required and the bounds of actuator failures can be unknown. Then an algorithm is proposed to determine the control parameters of the fault-tolerant formation protocol, where the time-varying formation feasible conditions and an approach to expand the feasible formation set are given. Furthermore, the stability of the proposed algorithm is proven based on the Lyapunov-like theory. Finally, two simulation examples are given to demonstrate the effectiveness of the theoretical results.