Enhancing deep neural network training efficiency and performance through linear prediction.

Deep neural networks have achieved remarkable success in various fields. However, training an effective deep neural network still poses challenges. This paper aims to propose a method to optimize the training effectiveness of deep neural networks, with the goal of improving their performance. Firstly, based on the observation that parameters (weights and bias) of deep neural network change in certain rules during training process, the potential of parameters prediction for improving training efficiency is discovered. Secondly, the potential of parameters prediction to improve the performance of deep neural network by noise injection introduced by prediction errors is revealed. And then, considering the limitations comprehensively, a deep neural network Parameters Linear Prediction method is exploit. Finally, performance and hyperparameter sensitivity validations are carried out on some representative backbones. Experimental results show that by employing proposed Parameters Linear Prediction method, as opposed to SGD, has led to an approximate 1% increase in accuracy for optimal model, along with a reduction of about 0.01 in top-1/top-5 error. Moreover, it also exhibits stable performance under various hyperparameter settings, shown the effectiveness of the proposed method and validated its capacity in enhancing network's training efficiency and performance.

Research on fault diagnosis method of planetary gearbox based on dynamic simulation and deep transfer learning.

To address the issue of not having enough labeled fault data for planetary gearboxes in actual production, this research develops a simulation data-driven deep transfer learning fault diagnosis method that applies fault diagnosis knowledge from a dynamic simulation model to an actual planetary gearbox. Massive amounts of different fault simulation data are collected by creating a dynamic simulation model of a planetary gearbox. A fresh deep transfer learning network model is built by fusing one-dimensional convolutional neural networks, attention mechanisms, and domain adaptation methods. The network model is used to learn domain invariant features from simulated data, thereby enabling fault diagnosis on real data. The fault diagnosis experiment is verified by using the Drivetrain Diagnostics Simulator test bench. The validity of the proposed means is evaluated by comparing the diagnostic accuracy of various means on various diagnostic tasks.