Tool Condition Monitoring Using Machine Tool Spindle Current and Long Short-Term Memory Neural Network Model Analysis.

In cutting processes, tool condition affects the quality of the manufactured parts. As such, an essential component to prevent unplanned downtime and to assure machining quality is having information about the state of the cutting tool. The primary function of it is to alert the operator that the tool has reached or is reaching a level of wear beyond which behaviour is unreliable. In this paper, the tool condition is being monitored by analysing the electric current on the main spindle via an artificial intelligence model utilising an LSTM neural network. In the current study, the tool is monitored while working on a cylindrical raw piece made of AA6013 aluminium alloy with a custom polycrystalline diamond tool for the purposes of monitoring the wear of these tools. Spindle current characteristics were obtained using external measuring equipment to not influence the operation of the machine included in a larger production line. As a novel approach, an artificial intelligence model based on an LSTM neural network is utilised for the analysis of the spindle current obtained during a manufacturing cycle and assessing the tool wear range in real time. The neural network was designed and trained to notice significant characteristics of the captured current signal. The conducted research serves as a proof of concept for the use of an LSTM neural network-based model as a method of monitoring the condition of cutting tools.

Fault Diagnosis and Prediction System for Metal Wire Feeding Additive Manufacturing.

In the process of metal wire and additive manufacturing, due to changes in temperature, humidity, current, voltage, and other parameters, as well as the failure of machinery and equipment, a failure may occur in the manufacturing process that seriously affects the current situation of production efficiency and product quality. Based on the demand for monitoring of the key impact parameters of additive manufacturing, this paper develops a parameter monitoring and prediction system for the additive manufacturing feeding process to provide a basis for future fault diagnosis. The fault diagnosis and prediction system for metal wire supply and additive manufacturing utilizes STM 32 as its core, enabling the capture and transmission of temperature, humidity, current, and voltage data. The upper computer system, designed on the LabVIEW 2019 virtual instrument platform, incorporates an LSTM neural network model and facilitates a connection between LabVIEW and MATLAB 2019 to achieve the prediction function. The monitoring and prediction system established in this study is intended to provide basic research assistance in the field of fault diagnosis.

Surrogate Modelling for Oxygen Uptake Prediction Using LSTM Neural Network.

Oxygen uptake (V˙O2) is an important metric in any exercise test including walking and running. It can be measured using portable spirometers or metabolic analyzers. Those devices are, however, not suitable for constant use by consumers due to their costs, difficulty of operation and their intervening in the physical integrity of their users. Therefore, it is important to develop approaches for the indirect estimation of V˙O2-based measurements of motion parameters, heart rate data and application-specific measurements from consumer-grade sensors. Typically, these approaches are based on linear regression models or neural networks. This study investigates how motion data contribute to V˙O2 estimation accuracy during unconstrained running and walking. The results suggest that a long short term memory (LSTM) neural network can predict oxygen consumption with an accuracy of 2.49 mL/min/kg (95% limits of agreement) based only on speed, speed change, cadence and vertical oscillation measurements from an inertial navigation system combined with a Global Positioning System (INS/GPS) device developed by our group, worn on the torso. Combining motion data and heart rate data can significantly improve the V˙O2 estimation resulting in approximately 1.7-1.9 times smaller prediction errors than using only motion or heart rate data.

A Hybrid Missing Data Imputation Method for Batch Process Monitoring Dataset.

Batch process monitoring datasets usually contain missing data, which decreases the performance of data-driven modeling for fault identification and optimal control. Many methods have been proposed to impute missing data; however, they do not fulfill the need for data quality, especially in sensor datasets with different types of missing data. We propose a hybrid missing data imputation method for batch process monitoring datasets with multi-type missing data. In this method, the missing data is first classified into five categories based on the continuous missing duration and the number of variables missing simultaneously. Then, different categories of missing data are step-by-step imputed considering their unique characteristics. A combination of three single-dimensional interpolation models is employed to impute transient isolated missing values. An iterative imputation based on a multivariate regression model is designed for imputing long-term missing variables, and a combination model based on single-dimensional interpolation and multivariate regression is proposed for imputing short-term missing variables. The Long Short-Term Memory (LSTM) model is utilized to impute both short-term and long-term missing samples. Finally, a series of experiments for different categories of missing data were conducted based on a real-world batch process monitoring dataset. The results demonstrate that the proposed method achieves higher imputation accuracy than other comparative methods.

Parameter Optimization of Model Predictive Direct Motion Control for Distributed Drive Electric Vehicles Considering Efficiency and the Driving Feeling.

This paper presents a novel motion control strategy based on model predictive control (MPC) for distributed drive electric vehicles (DDEVs), aiming to simultaneously control the longitudinal and lateral motion while considering efficiency and the driving feeling. Initially, we analyze the vehicle's dynamic model, considering the vehicle body and in-wheel motors, to establish the foundation for model predictive control. Subsequently, we propose a model predictive direct motion control (MPDMC) approach that utilizes a single CPU to directly follow the driver's commands by generating voltage references with a minimum cost function. The cost function of MPDMC is constructed, incorporating factors such as the longitudinal velocity, yaw rate, lateral displacement, and efficiency. We extensively analyze the weighting parameters of the cost function and introduce an optimization algorithm based on particle swarm optimization (PSO). This algorithm takes into account the aforementioned factors as well as the driving feeling, which is evaluated using a trained long short-term memory (LSTM) neural network. The LSTM network labels the response under different weighting parameters in various working conditions, i.e., "Nor", "Eco", and "Spt". Finally, we evaluate the performance of the optimized MPDMC through simulations conducted using MATLAB and CarSim software. Four typical scenarios are considered, and the results demonstrate that the optimized MPDMC outperforms the baseline methods, achieving the best performance.

Signal Recovery from Randomly Quantized Data Using Neural Network Approach.

We present an efficient scheme based on a long short-term memory (LSTM) autoencoder for accurate seismic deconvolution in a multichannel setup. The technique is beneficial for compressing massive amounts of seismic data. The proposed robust estimation ensures the recovery of sparse reflectivity from acquired seismic data that have been under-quantized. By adjusting the quantization error, the technique considerably improves the robustness of data to the quantization error, thereby boosting the visual saliency of seismic data compared to the other existing algorithms. This framework has been validated using both field and synthetic seismic data sets, and the assessment is carried out by comparing it to the steepest decent and basis pursuit methods. The findings indicate that the proposed scheme outperforms the other algorithms significantly in the following ways: first, in the proposed estimation, fraudulently or overbearingly estimated impulses are significantly suppressed, and second, the proposed guesstimate is much more robust to the quantization interval changes. The tests on real and synthetic data sets reveal that the proposed LSTM autoencoder-based method yields the best results in terms of both quality and computational complexity when compared with existing methods. Finally, the relative reconstruction error (RRE), signal-to-reconstruction error ratio (SRER), and power spectral density (PSD) are used to evaluate the performance of the proposed algorithm.

CVDF DYNAMIC-A Dynamic Fuzzy Testing Sample Generation Framework Based on BI-LSTM and Genetic Algorithm.

As one of the most effective methods of vulnerability mining, fuzzy testing has scalability and complex path detection ability. Fuzzy testing sample generation is the key step of fuzzy testing, and the quality of sample directly determines the vulnerability mining ability of fuzzy tester. At present, the known sample generation methods focus on code coverage or seed mutation under a critical execution path, so it is difficult to take both into account. Therefore, based on the idea of ensemble learning in artificial intelligence, we propose a fuzzy testing sample generation framework named CVDF DYNAMIC, which is based on genetic algorithm and BI-LSTM neural network. The main purpose of CVDF DYNAMIC is to generate fuzzy testing samples with both code coverage and path depth detection ability. CVDF DYNAMIC generates its own test case sets through BI-LSTM neural network and genetic algorithm. Then, we integrate the two sample sets through the idea of ensemble learning to obtain a sample set with both code coverage and vulnerability mining ability for a critical execution path of the program. In order to improve the efficiency of fuzzy testing, we use heuristic genetic algorithm to simplify the integrated sample set. We also innovatively put forward the evaluation index of path depth detection ability (pdda), which can effectively measure the vulnerability mining ability of the generated test case set under the critical execution path of the program. Finally, we compare CVDF DYNAMIC with some existing fuzzy testing tools and scientific research results and further propose the future improvement ideas of CVDF DYNAMIC.

An Adaptive Sinusoidal-Disturbance-Strategy Sparrow Search Algorithm and Its Application.

In light of the problems of slow convergence speed, insufficient optimization accuracy and easy falling into local optima in the sparrow search algorithm, this paper proposes an adaptive sinusoidal-disturbance-strategy sparrow search algorithm (ASDSSA) and its mathematical equation. Firstly, the initial population quality of the algorithm is improved by fusing cubic chaos mapping and perturbation compensation factors; secondly, the sinusoidal-disturbance-strategy is introduced to update the mathematical equation of the discoverer's position to improve the information exchange ability of the population and the global search performance of the algorithm; finally, the adaptive Cauchy mutation strategy is used to improve the ability of the algorithm to jump out of the local optimal solutions. Through the optimization experiments on eight benchmark functions and CEC2017 test functions, as well as the Wilcoxon rank-sum test and time complexity analysis, the results show that the improved algorithm has better optimization performance and convergence efficiency. Further, the improved algorithm was applied to optimize the parameters of the long short term memory network (LSTM) model for passenger flow prediction on selected metro passenger flow datasets. The effectiveness and feasibility of the improved algorithm were verified by experiments.

A Time Series Data Filling Method Based on LSTM-Taking the Stem Moisture as an Example.

In order to solve the problem of data loss in sensor data collection, this paper took the stem moisture data of plants as the object, and compared the filling value of missing data in the same data segment with different data filling methods to verify the validity and accuracy of the stem water filling data of the LSTM (Long Short-Term Memory) model. This paper compared the accuracy of missing stem water data for plants under different data filling methods to solve the problem of data loss in sensor data collection. Original stem moisture data was selected from Lagerstroemia Indica which was planted in the Haidian District of Beijing in June 2017. Part of the data which treated as missing data was manually deleted. Interpolation methods, time series statistical methods, the RNN (Recurrent Neural Network), and LSTM neural network were used to fill in the missing part and the filling results were compared with the original data. The result shows that the LSTM has more accurate performance than the RNN. The error values of the bidirectional LSTM model are the smallest among several models. The error values of the bidirectional LSTM are much lower than other methods. The MAPE (mean absolute percent error) of the bidirectional LSTM model is 1.813%. After increasing the length of the training data, the results further proved the effectiveness of the model. Further, in order to solve the problem of one-dimensional filling error accumulation, the LSTM model is used to conduct the multi-dimensional filling experiment with environmental data. After comparing the filling results of different environmental parameters, three environmental parameters of air humidity, photosynthetic active radiation, and soil temperature were selected as input. The results show that the multi-dimensional filling can greatly extend the sequence length while maintaining the accuracy, and make up for the defect that the one-dimensional filling accumulates errors with the increase of the sequence. The minimum MAPE of multidimensional filling is 1.499%. In conclusion, the data filling method based on LSTM neural network has a great advantage in filling the long-lost time series data which would provide a new idea for data filling.

Artificial Neural Networks in Motion Analysis-Applications of Unsupervised and Heuristic Feature Selection Techniques.

The use of machine learning to estimate joint angles from inertial sensors is a promising approach to in-field motion analysis. In this context, the simplification of the measurements by using a small number of sensors is of great interest. Neural networks have the opportunity to estimate joint angles from a sparse dataset, which enables the reduction of sensors necessary for the determination of all three-dimensional lower limb joint angles. Additionally, the dimensions of the problem can be simplified using principal component analysis. Training a long short-term memory neural network on the prediction of 3D lower limb joint angles based on inertial data showed that three sensors placed on the pelvis and both shanks are sufficient. The application of principal component analysis to the data of five sensors did not reveal improved results. The use of longer motion sequences compared to time-normalised gait cycles seems to be advantageous for the prediction accuracy, which bridges the gap to real-time applications of long short-term memory neural networks in the future.

An Attitude Prediction Method for Autonomous Recovery Operation of Unmanned Surface Vehicle.

The development of launch and recovery technology is key for the application to the unmanned surface vehicle (USV). Also, a launch and recovery system (L&RS) based on a pneumatic ejection mechanism has been developed in our previous study. To improve the launch accuracy and reduce the influence of the sea waves, we propose a stacking model of one-dimensional convolutional neural network and long short-term memory neural network predicting the attitude of the USV. The data from experiments by "Jinghai VII" USV developed by Shanghai University, China, under levels 1-4 sea conditions are used to train and test the network. The results show that the stabilized platform with the proposed prediction method can keep the launching angle of the launching mechanism constant by regulating the pitching joint and rotation joint under the random influence from the wave. Finally, the efficiency and effectiveness of the L&RS are demonstrated by the successful application in actual environments.

Attention-based recurrent neural network for influenza epidemic prediction.

BACKGROUND: Influenza is an infectious respiratory disease that can cause serious public health hazard. Due to its huge threat to the society, precise real-time forecasting of influenza outbreaks is of great value to our public. RESULTS: In this paper, we propose a new deep neural network structure that forecasts a real-time influenza-like illness rate (ILI%) in Guangzhou, China. Long short-term memory (LSTM) neural networks is applied to precisely forecast accurateness due to the long-term attribute and diversity of influenza epidemic data. We devise a multi-channel LSTM neural network that can draw multiple information from different types of inputs. We also add attention mechanism to improve forecasting accuracy. By using this structure, we are able to deal with relationships between multiple inputs more appropriately. Our model fully consider the information in the data set, targetedly solving practical problems of the Guangzhou influenza epidemic forecasting. CONCLUSION: We assess the performance of our model by comparing it with different neural network structures and other state-of-the-art methods. The experimental results indicate that our model has strong competitiveness and can provide effective real-time influenza epidemic forecasting.

Identifying tweets of personal health experience through word embedding and LSTM neural network.

BACKGROUND: As Twitter has become an active data source for health surveillance research, it is important that efficient and effective methods are developed to identify tweets related to personal health experience. Conventional classification algorithms rely on features engineered by human domain experts, and engineering such features is a challenging task and requires much human intelligence. The resultant features may not be optimal for the classification problem, and can make it challenging for conventional classifiers to correctly predict personal experience tweets (PETs) due to the various ways to express and/or describe personal experience in tweets. In this study, we developed a method that combines word embedding and long short-term memory (LSTM) model without the need to engineer any specific features. Through word embedding, tweet texts were represented as dense vectors which in turn were fed to the LSTM neural network as sequences. RESULTS: Statistical analyses of the results of 10-fold cross-validations of our method and conventional methods indicate that there exist significant differences (p < 0.01) in performance measures of accuracy, precision, recall, F1-score, and ROC/AUC, demonstrating that our approach outperforms the conventional methods in identifying PETs. CONCLUSION: We presented an efficient and effective method of identifying health-related personal experience tweets by combining word embedding and an LSTM neural network. It is conceivable that our method can help accelerate and scale up analyzing textual data of social media for health surveillance purposes, because of no need for the laborious and costly process of engineering features.

Optimization of epilepsy detection method based on dynamic EEG channel screening.

To decrease the interference in the process of epileptic feature extraction caused by insufficient detection capability in partial channels of focal epilepsy, this paper proposes a novel epilepsy detection method based on dynamic electroencephalogram (EEG) channel screening. This method not only extracts more effective epilepsy features but also finds common features among different epilepsy subjects, providing an effective approach and theoretical support for across-subject epilepsy detection in clinical scenarios. Firstly, we use the Refine Composite Multiscale Dispersion Entropy (RCMDE) to measure the complexity of EEG signals between normal and seizure states and realize the dynamic EEG channel screening among different subjects, which can enhance the capability of feature extraction and the robustness of epilepsy detection. Subsequently, we discover common epilepsy features in 3-15 Hz among different subjects by the screened EEG channels. By this finding, we construct the Residual Convolutional Long Short-Term Memory (ResCon-LSTM) neural network to accomplish across-subject epilepsy detection. The experiment results on the CHB-MIT dataset indicate that the highest accuracy of epilepsy detection in the single-subject experiment is 98.523 %, improved by 5.298 % compared with non-channel screening. In the across-subject experiment, the average accuracy is 96.596 %. Therefore, this method could be effectively applied to different subjects by dynamically screening optimal channels and keep a good detection performance.

Gas concentration prediction by LSTM network combined with wavelet thresholding denoising and phase space reconstruction.

The Long Short-Term Memory neural network is a specialized architecture designed for handling time series data, extensively applied in the field of predicting gas concentrations. In the harsh conditions prevalent in coal mines, the time series data of gas concentrations collected by sensors are susceptible to noise interference. Directly inputting such noisy data into a neural network for training would significantly reduce predictive accuracy and lead to deviations from the actual values. The Empirical Mode Decomposition method, commonly employed in gas concentration prediction, faces challenges in practical engineering applications due to the substantial influence of newly acquired data on the initial decomposition subsequence values. Consequently, it is difficult to use this method as intended. Conversely, the Wavelet Threshold Denoising method does not encounter this issue. Furthermore, gas concentration sequences exhibit chaotic characteristics. Performing phase space reconstruction allows for the extraction of additional valuable hidden information. In light of these factors, a prediction model is proposed, integrating WTD, Phase Space Reconstruction, and LSTM neural networks. Initially, the gas concentration sequence itself is subjected to wavelet threshold denoising. Subsequently, phase space reconstruction is performed, and the resulting reconstructed phase space matrix serves as the input for the LSTM neural network. The outcomes from the final LSTM neural network reveal that the PS method indeed extracts more valuable information. The Mean Absolute Error and Root Mean Square Error are reduced by 35.1% and 25%, respectively. Additionally, when compared to the PS-LSTM model without utilizing the WTD method, the WTD-PS-LSTM predictive model showcases reductions of 77.1% and 80% in MAE and RMSE, respectively. Compared with the LSTM model, the MAE and RMSE of the WTD-PS-LSTM prediction model were reduced by 81.4% and 82.6%, respectively. This greatly improves the credibility of whether or not a response related to coal mine safety management is implemented.

Deep learning models with optimized fluorescence spectroscopy to advance freshness of rainbow trout predicting under nonisothermal storage conditions.

This study established long short-term memory (LSTM), convolution neural network long short-term memory (CNN_LSTM), and radial basis function neural network (RBFNN) based on optimized excitation-emission matrix (EEM) from fish eye fluid to predict freshness changes of rainbow trout under nonisothermal storage conditions. The method of residual analysis, core consistency diagnostics, and split-half analysis of parallel factor analysis was used to optimize EEM data, and two characteristic components were extracted. LSTM, CNN_LSTM, and RBFNN models based on characteristic components of EEM used to predict the freshness indices. The results demonstrated the relative errors of RBFNN models with an R2 above 0.96 and relative errors less than 10% for K-value, total viable counts, and volatile base nitrogen, which were better than those of LSTM and CNN_LSTM models. This study presents a novel approach for predicting the freshness of rainbow trout under nonisothermal storage conditions.

Indentation Reverse Algorithm of Mechanical Response for Elastoplastic Coatings Based on LSTM Deep Learning.

The load-penetration depth (P-h) curves of different metallic coating materials can be determined by nanoindentation experiments, and it is a challenge to obtain stress-strain response and elastoplastic properties directly using P-h curves. These problems can be solved by means of finite element (FE) simulation along with reverse analyses and methods, which, however, typically occupy a lengthy time, in addition to the low generality of FE methodologies for different metallic materials. To eliminate the challenges that exist in conventional FE simulations, a long short-term memory (LSTM) neural network is proposed in this study and implemented to deep learn the time series of P-h curves, which is capable of mapping P-h curves to the corresponding stress-strain responses for elastoplastic materials. Prior to the operation of the neural network, 1000 sets of indentation data of metallic coating materials were generated using the FE method as the training and validating sets. Each dataset contains a set of P-h curves as well as the corresponding stress-strain curves, which are used as input data for the network and as training targets. The proposed LSTM neural networks, with various numbers of hidden layers and hidden units, are evaluated to determine the optimal hyperparameters by comparing their loss curves. Based on the analysis of the prediction results of the network, it is concluded that the relationship between the P-h curves of metallic coating materials and their stress-strain responses is well predicted, and this relationship basically coincides with the power-law equation. Furthermore, the deep learning method based on LSTM is advantageous to interpret the elastoplastic behaviors of coating materials from indentation measurement, making the predictions of stress-strain responses much more efficient than FE analysis. The established LSTM neural network exhibits the prediction accuracy up to 97%, which is proved to reliably satisfy the engineering requirements in practice.

Urban Flooding Prediction Method Based on the Combination of LSTM Neural Network and Numerical Model.

At present, urban flood risk analysis and forecasting and early warning mainly use numerical models for simulation and analysis, which are more accurate and can reflect urban flood risk well. However, the calculation speed of numerical models is slow and it is difficult to meet the needs of daily flood control and emergency. How to use artificial intelligence technology to quickly predict urban flooding is a key concern and a problem that needs to be solved. Therefore, this paper combines a numerical model with good computational accuracy and an LSTM artificial neural network model with high computational efficiency to propose a new method for fast prediction of urban flooding risk. The method uses the simulation results of the numerical model of urban flooding as the data driver to construct the LSTM neural network prediction model of each waterlogging point. The results show that the method has a high prediction accuracy and fast calculation speed, which can meet the needs of daily flood control and emergency response, and provides a new idea for the application of artificial intelligence technology in the direction of flood prevention and mitigation.

Brain model state space reconstruction using an LSTM neural network.

Objective. Kalman filtering has previously been applied to track neural model states and parameters, particularly at the scale relevant to electroencephalography (EEG). However, this approach lacks a reliable method to determine the initial filter conditions and assumes that the distribution of states remains Gaussian. This study presents an alternative, data-driven method to track the states and parameters of neural mass models (NMMs) from EEG recordings using deep learning techniques, specifically a long short-term memory (LSTM) neural network.Approach. An LSTM filter was trained on simulated EEG data generated by a NMM using a wide range of parameters. With an appropriately customised loss function, the LSTM filter can learn the behaviour of NMMs. As a result, it can output the state vector and parameters of NMMs given observation data as the input.Main results. Test results using simulated data yielded correlations withRsquared of around 0.99 and verified that the method is robust to noise and can be more accurate than a nonlinear Kalman filter when the initial conditions of the Kalman filter are not accurate. As an example of real-world application, the LSTM filter was also applied to real EEG data that included epileptic seizures, and revealed changes in connectivity strength parameters at the beginnings of seizures.Significance. Tracking the state vector and parameters of mathematical brain models is of great importance in the area of brain modelling, monitoring, imaging and control. This approach has no need to specify the initial state vector and parameters, which is very difficult to do in practice because many of the variables being estimated cannot be measured directly in physiological experiments. This method may be applied using any NMM and, therefore, provides a general, novel, efficient approach to estimate brain model variables that are often difficult to measure.

Forecasting regional short-term freight volume using QPSO-LSTM algorithm from the perspective of the importance of spatial information.

It is of great significance to accurately and efficiently predict expressway freight volume to improving the supervision level of the transportation industry and reflect the performance of transportation. Using expressway toll system records to predict regional freight volume plays an important role in the development of expressway freight organization work; especially, the short-term (hour, daily or monthly) freight volume is directly related to the compilation of regional transportation plans. Artificial neural networks have been widely used in forecasting in various fields because of their unique structural characteristics and strong learning ability, among which the long short-term memory (LSTM) network is suitable for processing and predicting series with time interval attributes such as expressway freight volume data. Considering the factors affecting regional freight volume, the data set was reconstructed from the perspective of spatial importance; we then use a quantum particle swarm optimization (QPSO) algorithm to tune parameters for a conventional LSTM model. In order to verify the efficiency and practicability, we first selected the expressway toll collection system data of Jilin Province from January 2018 to June 2021, and then used database and statistical knowledge to construct the LSTM data set. In the end, we used a QPSO-LSTM algorithm to predict the freight volume at the future times (hour, daily or monthly). Compared with the conventional LSTM model without tuning, the results of four randomly selected grids naming Changchun City, Jilin city, Siping City and Nong'an County show that the QPSO-LSTM network model based on spatial importance has a better effect.