Transfer Learning-Motivated Intelligent Fault Diagnosis Designs: A Survey, Insights, and Perspectives.

Over the last decade, transfer learning has attracted a great deal of attention as a new learning paradigm, based on which fault diagnosis (FD) approaches have been intensively developed to improve the safety and reliability of modern automation systems. Because of inevitable factors such as the varying work environment, performance degradation of components, and heterogeneity among similar automation systems, the FD method having long-term applicabilities becomes attractive. Motivated by these facts, transfer learning has been an indispensable tool that endows the FD methods with self-learning and adaptive abilities. On the presentation of basic knowledge in this field, a comprehensive review of transfer learning-motivated FD methods, whose two subclasses are developed based on knowledge calibration and knowledge compromise, is carried out in this survey article. Finally, some open problems, potential research directions, and conclusions are highlighted. Different from the existing reviews of transfer learning, this survey focuses on how to utilize previous knowledge specifically for the FD tasks, based on which three principles and a new classification strategy of transfer learning-motivated FD techniques are also presented. We hope that this work will constitute a timely contribution to transfer learning-motivated techniques regarding the FD topic.

On the philosophical, cognitive and mathematical foundations of symbiotic autonomous systems.

Symbiotic autonomous systems (SAS) are advanced intelligent and cognitive systems that exhibit autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies. Basic research in the emerging field of SAS has triggered advanced general-AI technologies that either function without human intervention or synergize humans and intelligent machines in coherent cognitive systems. This work presents a theoretical framework of SAS underpinned by the latest advances in intelligence, cognition, computer, and system sciences. SAS are characterized by the composition of autonomous and symbiotic systems that adopt bio-brain-social-inspired and heterogeneously synergized structures and autonomous behaviours. This paper explores the cognitive and mathematical foundations of SAS. The challenges to seamless human-machine interactions in a hybrid environment are addressed. SAS-based collective intelligence is explored in order to augment human capability by autonomous machine intelligence towards the next generation of general AI, cognitive computers, and trustworthy mission-critical intelligent systems. Emerging paradigms and engineering applications of SAS are elaborated via autonomous knowledge learning systems that symbiotically work between humans and cognitive robots. This article is part of the theme issue 'Towards symbiotic autonomous systems'.

Industrial applications of digital twins.

A digital twin (DT) is classically defined as the virtual replica of a real-world product, system, being, communities, even cities that are continuously updated with data from its physical counterpart, as well as its environment. It bridges the virtual cyberspace with the physical entities and, as such, is considered to be the pillar of Industry 4.0 and the innovation backbone of the future. A DT is created and used throughout the whole life cycle of the entity it replicates, from cradle to grave, so to speak. This article focuses on the present state of the art of DTs, concentrating on the use of DTs in industry in the context of smart manufacturing, especially from the point of view of plantwide optimization. The main capabilities of DTs (mirroring, shadowing and threading) are discussed in this context. The article concludes with a perspective on the future. This article is part of the theme issue 'Towards symbiotic autonomous systems'.

Fuzzy Approximation-Based Finite-Time Control for a Robot With Actuator Saturation Under Time-Varying Constraints of Work Space.

A finite-time control method is presented for n -link robots with actuator saturation under time-varying constraints of work space. Barrier Lyapunov functions (BLFs) are designed for ensuring that the robot remains under time-varying constraints of the work space. In order to deal with asymmetric saturation nonlinearity, we transform asymmetric saturation into a symmetric one by using a hyperbolic tangent function, which is introduced to avoid the discontinuous problem existing in the auxiliary system-based saturation method. Combining fuzzy-logic systems (FLSs) with the backstepping technique, a finite-time control policy is designed for ensuring the stability of the closed-loop system. With the use of the Lyapunov stability theory, all the error signals are proved to be semiglobal finite-time stable (SGFS). Finally, the experiment is carried out to verify the effectiveness of the finite-time method.

Spatiotemporal Behind-the-Meter Load and PV Power Forecasting via Deep Graph Dictionary Learning.

In recent years, with the rapid growth of rooftop photovoltaic (PV) generation in distribution networks, power system operators call for accurate forecasts of the behind-the-meter (BTM) load and PV generation. However, the existing forecasting methodologies are incapable of quantifying such BTM measurements as the smart meters can merely measure the net load time series. Motivated by this challenge, this article presents the spatiotemporal BTM load and PV forecasting (ST-BTMLPVF) problem. The objective is to disaggregate the historical net loads of neighboring residential units into their BTM load and PV generation and forecast the future values of these unobservable time series. To solve ST-BTMLPVF, we model the units as a spatiotemporal graph (ST-graph) where the nodes represent the net load measurements of units and edges reflect the mutual correlation between the units. An ST-graph autoencoder (ST-GAE) is devised to capture the spatiotemporal manifold of the ST-graph, and a novel spatiotemporal graph dictionary learning (STGDL) optimization is proposed to utilize the latent features of the ST-GAE to find the most significant spatiotemporal features of the net load. STGDL utilizes the captured features to estimate the historical BTM load and PV measurements, which are further used by a deep recurrent structure to forecast the future values of BTM load and PV generation at each unit. Numerical experiments on a real-world load and PV data set show the state-of-the-art performance of the proposed model, both for the BTM disaggregation and forecasting tasks.

Disturbance Observer-Based Neural Network Control of Cooperative Multiple Manipulators With Input Saturation.

In this paper, the complex problems of internal forces and position control are studied simultaneously and a disturbance observer-based radial basis function neural network (RBFNN) control scheme is proposed to: 1) estimate the unknown parameters accurately; 2) approximate the disturbance experienced by the system due to input saturation; and 3) simultaneously improve the robustness of the system. More specifically, the proposed scheme utilizes disturbance observers, neural network (NN) collaborative control with an adaptive law, and full state feedback. Utilizing Lyapunov stability principles, it is shown that semiglobally uniformly bounded stability is guaranteed for all controlled signals of the closed-loop system. The effectiveness of the proposed controller as predicted by the theoretical analysis is verified by comparative experimental studies.

A Locally Weighted Project Regression Approach-Aided Nonlinear Constrained Tracking Control.

An intelligent data-driven predictive control strategy is proposed in this paper. The predictive controller is designed by combining predictive control and local weighted projection regression. The presented control strategy needs less prior knowledge and has fewer parameters that are hard to determine compared to other data-driven predictive controller, e.g., the one in dynamic partial least square (PLS) framework. Furthermore, the proposed predictive controller performs better in the control of nonlinear processes and is able to update its parameters based on the online data. The predictive model validity and intelligence of the control strategy are guaranteed by the online updating strategy to a certain degree. The control performance of the proposed predictive controller against the model predictive control (MPC) in dynamic PLS framework is illustrated through the simulation of a typical numerical example and the benchmark of a continuous stirred tank heater system. It can be observed from the simulation that the proposed MPC strategy has higher prediction precision and stronger ability in coping with nonlinear dynamic processes which are quite common in practical applications, for instance, the industrial process.

Fault Detection for Nonlinear Process With Deterministic Disturbances: A Just-In-Time Learning Based Data Driven Method.

Data-driven fault detection plays an important role in industrial systems due to its applicability in case of unknown physical models. In fault detection, disturbances must be taken into account as an inherent characteristic of processes. Nevertheless, fault detection for nonlinear processes with deterministic disturbances still receive little attention, especially in data-driven field. To solve this problem, a just-in-time learning-based data-driven (JITL-DD) fault detection method for nonlinear processes with deterministic disturbances is proposed in this paper. JITL-DD employs JITL scheme for process description with local model structures to cope with processes dynamics and nonlinearity. The proposed method provides a data-driven fault detection solution for nonlinear processes with deterministic disturbances, and owns inherent online adaptation and high accuracy of fault detection. Two nonlinear systems, i.e., a numerical example and a sewage treatment process benchmark, are employed to show the effectiveness of the proposed method.

An Adaptive NN-Based Approach for Fault-Tolerant Control of Nonlinear Time-Varying Delay Systems With Unmodeled Dynamics.

This paper presents an adaptive neural network (NN)-based fault-tolerant control approach for the compensation of actuator failures in nonlinear systems with time-varying delay. The novelty of this paper lies in the fact that both the lock in place and loss of effectiveness faults, unmodeled dynamics, and dynamic disturbances are catered for simultaneously. Furthermore, this is achieved by the adaptation of only one parameter, which simplifies the computation of the control effort, and therefore extends its applicability. In the approach, the Razumikhin lemma and a dynamic signal are employed. It is shown that the output of the system converges to a neighborhood of the reference signal and the semiglobal boundedness of all signals is guaranteed. A simulation example is used to illustrate the validity and efficacy of the approach.

Feedback error learning control of magnetic satellites using type-2 fuzzy neural networks with elliptic membership functions.

A novel type-2 fuzzy membership function (MF) in the form of an ellipse has recently been proposed in literature, the parameters of which that represent uncertainties are de-coupled from its parameters that determine the center and the support. This property has enabled the proposers to make an analytical comparison of the noise rejection capabilities of type-1 fuzzy logic systems with its type-2 counterparts. In this paper, a sliding mode control theory-based learning algorithm is proposed for an interval type-2 fuzzy logic system which benefits from elliptic type-2 fuzzy MFs. The learning is based on the feedback error learning method and not only the stability of the learning is proved but also the stability of the overall system is shown by adding an additional component to the control scheme to ensure robustness. In order to test the efficiency and efficacy of the proposed learning and the control algorithm, the trajectory tracking problem of a magnetic rigid spacecraft is studied. The simulations results show that the proposed control algorithm gives better performance results in terms of a smaller steady state error and a faster transient response as compared to conventional control algorithms.

An investigation into soft error detection efficiency at operating system level.

Electronic equipment operating in harsh environments such as space is subjected to a range of threats. The most important of these is radiation that gives rise to permanent and transient errors on microelectronic components. The occurrence rate of transient errors is significantly more than permanent errors. The transient errors, or soft errors, emerge in two formats: control flow errors (CFEs) and data errors. Valuable research results have already appeared in literature at hardware and software levels for their alleviation. However, there is the basic assumption behind these works that the operating system is reliable and the focus is on other system levels. In this paper, we investigate the effects of soft errors on the operating system components and compare their vulnerability with that of application level components. Results show that soft errors in operating system components affect both operating system and application level components. Therefore, by providing endurance to operating system level components against soft errors, both operating system and application level components gain tolerance.

Optimal Selection of Parameters for Nonuniform Embedding of Chaotic Time Series Using Ant Colony Optimization.

The optimal selection of parameters for time-delay embedding is crucial to the analysis and the forecasting of chaotic time series. Although various parameter selection techniques have been developed for conventional uniform embedding methods, the study of parameter selection for nonuniform embedding is progressed at a slow pace. In nonuniform embedding, which enables different dimensions to have different time delays, the selection of time delays for different dimensions presents a difficult optimization problem with combinatorial explosion. To solve this problem efficiently, this paper proposes an ant colony optimization (ACO) approach. Taking advantage of the characteristic of incremental solution construction of the ACO, the proposed ACO for nonuniform embedding (ACO-NE) divides the solution construction procedure into two phases, i.e., selection of embedding dimension and selection of time delays. In this way, both the embedding dimension and the time delays can be optimized, along with the search process of the algorithm. To accelerate search speed, we extract useful information from the original time series to define heuristics to guide the search direction of ants. Three geometry- or model-based criteria are used to test the performance of the algorithm. The optimal embeddings found by the algorithm are also applied in time-series forecasting. Experimental results show that the ACO-NE is able to yield good embedding solutions from both the viewpoints of optimization performance and prediction accuracy.

Analysis of the noise reduction property of type-2 fuzzy logic systems using a novel type-2 membership function.

In this paper, the noise reduction property of type-2 fuzzy logic (FL) systems (FLSs) (T2FLSs) that use a novel type-2 fuzzy membership function is studied. The proposed type-2 membership function has certain values on both ends of the support and the kernel and some uncertain values for the other values of the support. The parameter tuning rules of a T2FLS that uses such a membership function are derived using the gradient descend learning algorithm. There exist a number of papers in the literature that claim that the performance of T2FLSs is better than type-1 FLSs under noisy conditions, and the claim is tried to be justified by simulation studies only for some specific systems. In this paper, a simpler T2FLS is considered with the novel membership function proposed in which the effect of input noise in the rule base is shown numerically in a general way. The proposed type-2 fuzzy neuro structure is tested on different input-output data sets, and it is shown that the T2FLS with the proposed novel membership function has better noise reduction property when compared to the type-1 counterparts.

A dynamic method to forecast the wheel slip for antilock braking system and its experimental evaluation.

The control of an antilock braking system (ABS) is a difficult problem due to its strongly nonlinear and uncertain characteristics. To overcome this difficulty, the integration of gray-system theory and sliding-mode control is proposed in this paper. This way, the prediction capabilities of the former and the robustness of the latter are combined to regulate optimal wheel slip depending on the vehicle forward velocity. The design approach described is novel, considering that a point, rather than a line, is used as the sliding control surface. The control algorithm is derived and subsequently tested on a quarter vehicle model. Encouraged by the simulation results indicating the ability to overcome the stated difficulties with fast convergence, experimental results are carried out on a laboratory setup. The results presented indicate the potential of the approach in handling difficult real-time control problems.

Robust and adaptive backstepping control for nonlinear systems using RBF neural networks.

In this paper, two different backstepping neural network (NN) control approaches are presented for a class of affine nonlinear systems in the strict-feedback form with unknown nonlinearities. By a special design scheme, the controller singularity problem is avoided perfectly in both approaches. Furthermore, the closed loop signals are guaranteed to be semiglobally uniformly ultimately bounded and the outputs of the system are proved to converge to a small neighborhood of the desired trajectory. The control performances of the closed-loop systems can be shaped as desired by suitably choosing the design parameters. Simulation results obtained demonstrate the effectiveness of the approaches proposed. The differences observed between the inputs of the two controllers are analyzed briefly.