Novel Dynamic Event-Triggered Consensus Control of Multiagent Systems With Markovian Switching Topologies Under DoS Attacks.

This article focuses on the issue of novel dynamic event-triggered consensus control of multiagent systems (MASs) with denial-of-service (DoS) attacks. Different from the conventional Markovian switching topologies, the generally uncertain semi-Markovian (GUSM) switching topologies with partially unknown elements and time-dependent uncertainties are constructed for the leader-following MASs by considering the equipment performance and external uncertain environment influence. To save communication resources, the novel dynamic memory event-triggered strategy (DMETS) is presented to decrease the frequency of communication between agents. Some secure consensus control criteria are established for the MASs with GUSM switching topologies and DoS attacks due to the potential system communication disruption caused by attackers. Finally, two physical system examples are designed to prove the effectiveness of the presented method.

ADP-Based Fault-Tolerant Control for Multiagent Systems With Semi-Markovian Jump Parameters.

This article analyzes and validates an approach of integration of adaptive dynamic programming (ADP) and adaptive fault-tolerant control (FTC) technique to address the consensus control problem for semi-Markovian jump multiagent systems having actuator bias faults. A semi-Markovian process, a more versatile stochastic process, is employed to characterize the parameter variations that arise from the intricacies of the environment. The reliance on accurate knowledge of system dynamics is overcome through the utilization of an actor-critic neural network structure within the ADP algorithm. A data-driven FTC scheme is introduced, which enables online adjustment and automatic compensation of actuator bias faults. It has been demonstrated that the signals generated by the controlled system exhibit uniform boundedness. Additionally, the followers' states can achieve and maintain consensus with that of the leader. Ultimately, the simulation results are given to demonstrate the efficacy of the designed theoretical findings.

Nussbaum-Based Adaptive Neural Networks Tracking Control for Nonlinear PDE-ODE Systems Subject to Deception Attacks.

In this article, the novel adaptive neural networks (NNs) tracking control scheme is presented for nonlinear partial differential equation (PDE)-ordinary differential equation (ODE) coupled systems subject to deception attacks. Because of the special infinite-dimensional characteristics of PDE subsystem and the strong coupling of PDE-ODE systems, it is more difficult to achieve the tracking control for coupled systems than single ODE system under the circumstance of deception attacks, which result in the states and outputs of both PDE and ODE subsystems unavailable by injecting false information into sensors and actuators. For efficient design of the controllers to realize the tracking performance, a new coordinate transformation is developed under the backstepping method, and the PDE subsystem is transformed into a new form. In addition, the effect of the unknown control gains and the uncertain nonlinearities caused by attacks are alleviated by introducing the Nussbaum technology and NNs. The proposed tracking control scheme can guarantee that all signals in the coupled systems are bounded and the good tracking performance can be achieved, despite both sensors and actuators of the studied systems suffering from attacks. Finally, a simulation example is given to verify the effectiveness of the proposed control method.

Resilient Output Control of Multiagent Systems With DoS Attacks and Actuator Faults: Fully Distributed Event-Triggered Approach.

This article investigates the fully distributed resilient practical leader-follower bipartite output consensus (LFBOC) problem for heterogeneous linear multiagent systems (MASs) with denial-of-service (DoS) attacks and actuator faults. To estimate the leader matrix and state in the presence of DoS attacks, two novel adaptive event-triggered observers are proposed based on newly developed lemmas, and then the adaptive event-triggered fault-tolerant controller without chattering behavior is developed to solve the LFBOC problem. Different from most existing resilient practical LFBOC working with DoS attacks and actuator faults, our method does not rely on any global information, event-triggered communication between neighbors and discrete update controllers are implemented simultaneously. Finally, an example is presented to well illustrate the effectiveness of developed method.

Policy Iteration Q -Learning for Linear Itô Stochastic Systems With Markovian Jumps and Its Application to Power Systems.

This article addresses the solution of continuous-time linear Itô stochastic systems with Markovian jumps using an online policy iteration (PI) approach grounded in Q -learning. Initially, a model-dependent offline algorithm, structured according to traditional optimal control strategies, is designed to solve the algebraic Riccati equation (ARE). Employing Lyapunov theory, we rigorously derive the convergence of the offline PI algorithm and the admissibility of the iterative control law through mathematical analysis. This article represents the first attempt to tackle these technical challenges. Subsequently, to address the limitations inherent in the offline algorithm, we introduce a novel online Q -learning algorithm tailored for Itô stochastic systems with Markovian jumps. The proposed Q -learning algorithm obviates the need for transition probabilities and system matrices. We provide a thorough stability analysis of the closed-loop system. Finally, the effectiveness and applicability of the proposed algorithms are demonstrated through a simulation example, underpinned by the theorems established herein.

Optimized Backstepping Cooperative Control for Output-Constrained Stochastic Nonlinear Network Systems via a Multibridge-Hole Function.

In this article, a new leader-following tracking control approach is investigated for stochastic multiagent systems with multibridge-hole output constraints. The multibridge-hole output constraints mean that the output of the system is constrained in some intervals and unconstrained in other intervals. The constrained and unconstrained intervals can be set arbitrarily. By designing a new shift function to construct the barrier Lyapunov function, the optimal controller is constructed by combining the backstepping technique with the adaptive dynamic programming technique. The model network is used to estimate the unknown disturbances and uncertainty terms in the system. The critic network and the actor network are constructed such that the designed controller adheres to the Bellman optimality principle and gives the optimal solution of the system. The proposed control method is versatile and compatible with various types of output constrained control problems, such as unconstrained control problems, constrained control problems, and delay constrained problems without changing the structure of the controller. Finally, some simulation results are given to verify the effectiveness of the method.

Two-Layer Reinforcement Learning for Output Consensus of Multiagent Systems Under Switching Topology.

In this article, the data-based output consensus of discrete-time multiagent systems under switching topology (ST) is studied via reinforcement learning. Due to the existence of ST, the kernel matrix of value function is switching-varying, which cannot be applied to existing algorithms. To overcome the inapplicability of varying kernel matrix, a two-layer reinforcement learning algorithm is proposed in this article. To further implement the proposed algorithm, a data-based distributed control policy is presented, which is applicable to both fixed topology and ST. Besides, the proposed method does not need assumptions on the eigenvalues of leader's dynamic matrix, it avoids the assumptions in the previous method. Subsequently, the convergence of algorithm is analyzed. Finally, three simulation examples are provided to verify the proposed algorithm.

Dynamic Threshold Finite-Time Prescribed Performance Control for Nonlinear Systems With Dead-Zone Output.

This article investigates the tracking control problem for nonlinear systems. An adaptive model is proposed to represent the dead-zone phenomenon and solve its control challenge with a Nussbaum function in conjunction. Drawing inspiration from the existing prescribed performance control schemes, a novel dynamic threshold scheme is developed that fuses a proposed continuous function with a finite-time performance function. A dynamic event-triggered strategy is applied to reduce the redundant transmission. The proposed time-varying threshold control strategy has fewer updates than the traditional fixed threshold and improves the efficiency of resource utilization. A command filter backstepping approach is employed to prevent the complexity explosion faced by the computation. The suggested control strategy ensures that all system signals are bounded. The validity of the simulation results has been verified.

Fault-Tolerant Fuzzy-Resilient Control for Fractional-Order Stochastic Underactuated System With Unmodeled Dynamics and Actuator Saturation.

This article is considered on underactuated fractional-order stochastic systems (FOSSs) with actuator saturation and incrementally conic nonlinear terms, whose fractional-order α ∈ (0,1) . First, to bring FO dynamic signals, solving the unmodeled dynamics, in the meantime, the saturated nonlinear term of the control input is taken into account. At the time, to cope with the stability issue of FOSS under such situation, the fault tolerant resilient controller based on underactuated condition is designed. Then, according to the method of the Lyapunov and It∧ o differential formulation to design proper multiple Lyapunov-Krasovskii (L-K) functions, such that, a novel sufficient condition of the robustly asymptotically stability of fuzzy FOSS under underactuated conditions is rigorously proved in terms of linear matrix inequality (LMI). Furthermore, in order to research the mean square stability of the above-mentioned system, so the solution of FOSS is obtained to achieve this purpose. By applying the above method, which is proposed in this work that the controlled system can be obtained with faster response and higher control accuracy. At last, to display the superiority of the above-mentioned scheme is effective, tethered satellite system and numerical results are presented.

Cooperative Control for Stochastic Multiagent Systems With Deferred Dynamic Constraints via a Novel Universal Barrier Function Approach.

This article investigates the cooperative control problem for stochastic multiagent systems (MASs) with dynamic constraints. A new universal barrier function is proposed, which is applicable to many systems with different types of constraint functions, even unconstrained systems. Several mapping functions are constructed to constrain the state variables directly without feasibility conditions, and the tracking control is achieved for stochastic MASs with deferred full-state constraints under the backstepping framework. In order to regulate the tracking error more precisely, the funnel error transformation is improved and the deferred funnel controller is developed by introducing a preassigned finite-time function. Based on the deferred funnel controller, the tracking error can be maintained within the predetermined funnel in the preassigned time. The convergence time can be defined according to the actual requirements, and it is independent of the design controller parameters and initial conditions. Finally, some simulation results are given to demonstrate the effectiveness of the proposed control algorithm.

Adaptive Virotherapy Strategy for Organism With Constrained Input Using Medicine Dosage Regulation Mechanism.

In this article, the constrained adaptive control strategy based on virotherapy is investigated for organism using the medicine dosage regulation mechanism (MDRM). First, the tumor-virus-immune interaction dynamics is established to model the relations among the tumor cells (TCs), virus particles, and the immune response. The adaptive dynamic programming (ADP) method is extended to approximately obtain the optimal strategy for the interaction system to reduce the populations of TCs. Due to the consideration of asymmetric control constraints, the nonquadratic functions are proposed to formulate the value function such that the corresponding Hamilton-Jacobi-Bellman equation (HJBE) is derived which can be deemed as the cornerstone of ADP algorithms. Then, the ADP method of a single-critic network architecture which integrates MDRM is proposed to obtain the approximate solutions of HJBE and eventually derive the optimal strategy. The design of MDRM makes it possible for the dosage of the agentia containing oncolytic virus particles to be regulated timely and necessarily. Furthermore, the uniform ultimate boundedness of the system states and critic weight estimation errors is validated by Lyapunov stability analysis. Finally, simulation results are given to show the effectiveness of the derived therapeutic strategy.

Convergence Analysis of Value Iteration Adaptive Dynamic Programming for Continuous-Time Nonlinear Systems.

This article is concerned with the convergence property and error bounds analysis of value iteration (VI) adaptive dynamic programming for continuous-time (CT) nonlinear systems. The size relationship between the total value function and the single integral step cost is described by assuming a contraction assumption. Then, the convergence property of VI is proved while the initial condition is an arbitrary positive semidefinite function. Moreover, the accumulated effects of approximation errors generated in each iteration are taken into consideration while using approximators to implement the algorithm. Based on the contraction assumption, the error bounds condition is proposed, which ensures the approximated iterative results converge to a neighborhood of the optimum, and the relation between the optimal solution and approximated iterative results is also derived. To make the contraction assumption more concrete, an estimation way is proposed to derive a conservative value of the assumption. Finally, three simulation cases are given to validate the theoretical results.

Adaptive Dynamic Event-Triggered Distributed Output Observer for Leader-Follower Multiagent Systems Under Directed Graphs.

Leader-follower consensus problem for multiagent systems (MASs) is an important research hotspot. However, the existing methods take the leader system matrix as a priori knowledge for each agent to design the controller and use the leader's state information. In fact, only the output information may be available in some practical applications. On this basis, this article first designs a novel adaptive distributed dynamic event-triggered observer for each follower to learn the minimum polynomial coefficients of the leader system matrix instead of the leader system matrix. The proposed method is scalable and suitable for large-scale MASs and can reduce the information transmission dimension in observer design. Then, an adaptive dynamic event-triggered compensator based on the observer and leader output information is designed for each follower, thereby solving the leader-follower consensus problem. Finally, several simulation examples are given to verify the effectiveness of the proposed scheme.

A Dynamic Weights-Based Wavelet Attention Neural Network for Defect Detection.

Automatic defect detection plays an important role in industrial production. Deep learning-based defect detection methods have achieved promising results. However, there are still two challenges in the current defect detection methods: 1) high-precision detection of weak defects is limited and 2) it is difficult for current defect detection methods to achieve satisfactory results dealing with strong background noise. This article proposes a dynamic weights-based wavelet attention neural network (DWWA-Net) to address these issues, which can enhance the feature representation of defects and simultaneously denoise the image, thereby improving the detection accuracy of weak defects and defects under strong background noise. First, wavelet neural networks and dynamic wavelet convolution networks (DWCNets) are presented, which can effectively filter background noise and improve model convergence. Second, a multiview attention module is designed, which can direct the network attention toward potential targets, thereby guaranteeing the accuracy for detecting weak defects. Finally, a feature feedback module is proposed, which can enhance the feature information of defects to further improve the weak defect detection accuracy. The DWWA-Net can be used for defect detection in multiple industrial fields. Experiment results illustrate that the proposed method outperforms the state-of-the-art methods (mean precision: GC10-DET: 6.0%; NEU: 4.3%). The code is made in https://github.com/781458112/DWWA.

Distributed Multiagent-Based Event-Driven Fault-Tolerant Control of Islanded Microgrids.

This article proposes an observer-based event-driven fault-tolerant (OBEDFT) secondary control strategy for AC microgrids (MGs) to achieve load voltage regulation. First, the input-output feedback linearization method transforms the voltage regulation issue into an output feedback tracking problem for linear multiagent systems (MASs) with nonlinear dynamics. This transformation provides the necessary preprocessing for load voltage regulation. Then, an OBEDFT secondary control protocol that considers full-state immeasurability is proposed. The actuators of distributed generators (DGs) may experience partial loss of effectiveness (PLOE) and bias faults, and these fault parameters may be heterogeneous and time-varying. The protocol introduces adaptive techniques to avoid information related to fault parameters while using event-driven mechanisms to achieve discrete measurements of neighboring DG. Additionally, the protocol uses boundary layers to construct smooth controllers that prevent the chattering effect caused by nonsmooth controllers. Finally, simulation results confirm the effectiveness of this load voltage regulation strategy.

Preassigned Time Adaptive Neural Tracking Control for Stochastic Nonlinear Multiagent Systems With Deferred Constraints.

This article studies a preassigned time adaptive tracking control problem for stochastic multiagent systems (MASs) with deferred full state constraints and deferred prescribed performance. A modified nonlinear mapping is designed, which incorporates a class of shift functions, to eliminate the constraints on the initial value conditions. By virtue of this nonlinear mapping, the feasibility conditions of the full state constraints for stochastic MASs can also be circumvented. In addition, the Lyapunov function codesigned by the shift function and the fixed-time prescribed performance function is constructed. The unknown nonlinear terms of the converted systems are handled based on the approximation property of the neural networks. Furthermore, a preassigned time adaptive tracking controller is established, which can achieve deferred prescribed performance for stochastic MASs that provide only local information. Finally, a numerical example is given to demonstrate the effectiveness of the proposed scheme.

Sliding Mode Control Based on Reinforcement Learning for T-S Fuzzy Fractional-Order Multiagent System With Time-Varying Delays.

This article researches the sliding mode control (SMC) for fuzzy fractional-order multiagent system (FOMAS) subject to time-varying delays over directed networks based on reinforcement learning (RL), α ∈ (0,1). First, since there is information communication between an agent and another agent, a new distributed control policy ξi(t) is introduced so that the sharing of signals is implemented through RL, whose propose is to minimize the error variables with learning. Then, different from the existed papers studying normal fuzzy MASs, a new stability basis of fuzzy FOMASs with time-varying delay terms is presented to guarantee that the states of each agent eventually converge to the smallest possible domain of 0 using Lyapunov-Krasovskii functionals, free weight matrix, and linear matrix inequality (LMI). Furthermore, in order to provide appropriate parameters for SMC, the RL algorithm is combined with SMC strategy, and the constraints on the initial conditions of the control input ui(t) are eliminated, so that the sliding motion satisfy the reachable condition within a finite time. Finally, to illustrate that the proposed protocol is valid, the results of the simulation and numerical examples are presented.

Cooperative Containment Control for Multiagent Systems With Reduced-Order Protocols.

This article addresses the problem of containment control for continuous-time multiagent systems. A containment error is first given to show the coordination between the outputs of leaders and followers. Then, an observer is designed based on the neighbor observable convex hull state. Under the assumption that the designed reduced-order observer is subject to external disturbances, a reduced-order protocol is designed to realize the containment coordination. In order to ensure the designed control protocol can achieve the effect of the main theories, a corresponding Sylvester equation is given with a novel approach which proves that the Sylvester equation is solvable. Finally, a numerical example is given to verify the validity of the main results.

Distributed Observer-Based Robust Fault Estimation Design for Discrete-Time Interconnected Systems With Disturbances.

This article focuses on the distributed robust fault estimation problem for a kind of discrete-time interconnected systems with input and output disturbances. For each subsystem, by letting the fault as a special state, an augmented system is constructed. Particularly, the dimensions of system matrices after augmentation are lower than some existing related results, which may help to reduce calculation amount, especially, for linear matrix inequality-based conditions. Then, a distributed fault estimation observer design scheme that utilizes the associated information among subsystems is presented to not only reconstruct faults, but also suppress disturbances in the sense of robust H∞ optimization. Besides, to improve the fault estimation performance, a common Lyapunov matrix-based multiconstrained design method is first given to solve the observer gain, which is further extended to the different Lyapunov matrices-based multiconstrained calculation method. Thus, the conservatism is reduced. Finally, simulation experiments are shown to verify the validity of our distributed fault estimation scheme.

Dynamic Event-Based Control for Stochastic Optimal Regulation of Nonlinear Networked Control Systems.

In this article, a dynamic event-triggered stochastic adaptive dynamic programming (ADP)-based problem is investigated for nonlinear systems with a communication network. First, a novel condition of obtaining stochastic input-to-state stability (SISS) of discrete version is skillfully established. Then, the event-triggered control strategy is devised, and a near-optimal control policy is designed using an identifier-actor-critic neural networks (NNs) with an event-sampled state vector. Above all, an adaptive static event sampling condition is designed by using the Lyapunov technique to ensure ultimate boundedness (UB) for the closed-loop system. However, since the static event-triggered rule only depends on the current state, regardless of previous values, this article presents an explicit dynamic event-triggered rule. Furthermore, we prove that the lower bound of sampling interval for the proposed dynamic event-triggered control strategy is greater than one, which avoids the so-called triviality phenomenon. Finally, the effectiveness of the proposed near-optimal control pattern is verified by a simulation example.