A Visual-Inertial Pressure Fusion-Based Underwater Simultaneous Localization and Mapping System.

Detecting objects, particularly naval mines, on the seafloor is a complex task. In naval mine countermeasures (MCM) operations, sidescan or synthetic aperture sonars have been used to search large areas. However, a single sensor cannot meet the requirements of high-precision autonomous navigation. Based on the ORB-SLAM3-VI framework, we propose ORB-SLAM3-VIP, which integrates a depth sensor, an IMU sensor and an optical sensor. This method integrates the measurements of depth sensors and an IMU sensor into the visual SLAM algorithm through tight coupling, and establishes a multi-sensor fusion SLAM model. Depth constraints are introduced into the process of initialization, scale fine-tuning, tracking and mapping to constrain the position of the sensor in the z-axis and improve the accuracy of pose estimation and map scale estimate. The test on seven sets of underwater multi-sensor sequence data in the AQUALOC dataset shows that, compared with ORB-SLAM3-VI, the ORB-SLAM3-VIP system proposed in this paper reduces the scale error in all sequences by up to 41.2%, and reduces the trajectory error by up to 41.2%. The square root has also been reduced by up to 41.6%.

Sounding Mechanism of a Flue Organ Pipe-A Multi-Sensor Measurement Approach.

This work presents an approach that integrates the results of measuring, analyzing, and modeling air flow phenomena driven by pressurized air in a flue organ pipe. The investigation concerns a Bourdon organ pipe. Measurements are performed in an anechoic chamber using the Cartesian robot equipped with a 3D acoustic vector sensor (AVS) that acquires both acoustic pressure and air particle velocity. Also, a high-speed camera is employed to observe the jet coming out from the windway. For that purpose, the steam resulting from dry ice and hot water is used. A numerical simulation of the sounding mechanism of a pipe of the same geometry is based on measuring the pressure signal and the intensity field around the mouth employing an intensity probe and visualizing and observing the motion of the air jet, which represents the excitation mechanism of the system. The ParaVIEW software serves for the simulation and visualization of the air jet. Then, the results obtained from measurements and simulations are compared and discussed. Also, some future directions discussing the application of a machine-learning approach to the area of pipe organ air flow investigation are contained in the Conclusions section.

W-VSLAM: A Visual Mapping Algorithm for Indoor Inspection Robots.

In recent years, with the widespread application of indoor inspection robots, high-precision, robust environmental perception has become essential for robotic mapping. Addressing the issues of visual-inertial estimation inaccuracies due to redundant pose degrees of freedom and accelerometer drift during the planar motion of mobile robots in indoor environments, we propose a visual SLAM perception method that integrates wheel odometry information. First, the robot's body pose is parameterized in SE(2) and the corresponding camera pose is parameterized in SE(3). On this basis, we derive the visual constraint residuals and their Jacobian matrices for reprojection observations using the camera projection model. We employ the concept of pre-integration to derive pose-constraint residuals and their Jacobian matrices and utilize marginalization theory to derive the relative pose residuals and their Jacobians for loop closure constraints. This approach solves the nonlinear optimization problem to obtain the optimal pose and landmark points of the ground-moving robot. A comparison with the ORBSLAM3 algorithm reveals that, in the recorded indoor environment datasets, the proposed algorithm demonstrates significantly higher perception accuracy, with root mean square error (RMSE) improvements of 89.2% in translation and 98.5% in rotation for absolute trajectory error (ATE). The overall trajectory localization accuracy ranges between 5 and 17 cm, validating the effectiveness of the proposed algorithm. These findings can be applied to preliminary mapping for the autonomous navigation of indoor mobile robots and serve as a basis for path planning based on the mapping results.

Machine Tool Wear Prediction Technology Based on Multi-Sensor Information Fusion.

The intelligent monitoring of cutting tools used in the manufacturing industry is steadily becoming more convenient. To accurately predict the state of tools and tool breakages, this study proposes a tool wear prediction technique based on multi-sensor information fusion. First, the vibrational, current, and cutting force signals transmitted during the machining process were collected, and the features were extracted. Next, the Kalman filtering algorithm was used for feature fusion, and a predictive model for tool wear was constructed by combining the ResNet and long short-term memory (LSTM) models (called ResNet-LSTM). Experimental data for thin-walled parts obtained under various machining conditions were utilized to monitor the changes in tool conditions. A comparison between the ResNet and LSTM tool wear prediction models indicated that the proposed ResNet-LSTM model significantly improved the prediction accuracy compared to the individual LSTM and ResNet models. Moreover, ResNet-LSTM exhibited adaptive noise reduction capabilities at the front end of the network for signal feature extraction, thereby enhancing the signal feature extraction capability. The ResNet-LSTM model yielded an average prediction error of 0.0085 mm and a tool wear prediction accuracy of 98.25%. These results validate the feasibility of the tool wear prediction method proposed in this study.

Multi-Sensor Device for Traceable Monitoring of Indoor Environmental Quality.

The Indoor Environmental Quality (IEQ) combines thermal, visual, acoustic, and air-quality conditions in indoor environments and affects occupants' health, well-being, and comfort. Performing continuous monitoring to assess IEQ is increasingly proving to be important, also due to the large amount of time that people spend in closed spaces. In the present study, the design, development, and metrological characterization of a low-cost multi-sensor device is presented. The device is part of a wider system, hereafter referred to as PROMET&O (PROactive Monitoring for indoor EnvironmenTal quality & cOmfort), that also includes a questionnaire for the collection of occupants' feedback on comfort perception and a dashboard to show end users all monitored data. The PROMET&O multi-sensor monitors the quality conditions of indoor environments thanks to a set of low-cost sensors that measure air temperature, relative humidity, illuminance, sound pressure level, carbon monoxide, carbon dioxide, nitrogen dioxide, particulate matter, volatile organic compounds, and formaldehyde. The device architecture is described, and the design criteria related to measurement requirements are highlighted. Particular attention is paid to the calibration of the device to ensure the metrological traceability of the measurements. Calibration procedures, based on the comparison to reference standards and following commonly employed or ad hoc developed technical procedures, were defined and applied to the bare sensors of air temperature and relative humidity, carbon dioxide, illuminance, sound pressure level, particulate matter, and formaldehyde. The next calibration phase in the laboratory will be aimed at analyzing the mutual influences of the assembled multi-sensor hardware components and refining the calibration functions.

Improving SLAM Techniques with Integrated Multi-Sensor Fusion for 3D Reconstruction.

Simultaneous Localization and Mapping (SLAM) poses distinct challenges, especially in settings with variable elements, which demand the integration of multiple sensors to ensure robustness. This study addresses these issues by integrating advanced technologies like LiDAR-inertial odometry (LIO), visual-inertial odometry (VIO), and sophisticated Inertial Measurement Unit (IMU) preintegration methods. These integrations enhance the robustness and reliability of the SLAM process for precise mapping of complex environments. Additionally, incorporating an object-detection network aids in identifying and excluding transient objects such as pedestrians and vehicles, essential for maintaining the integrity and accuracy of environmental mapping. The object-detection network features a lightweight design and swift performance, enabling real-time analysis without significant resource utilization. Our approach focuses on harmoniously blending these techniques to yield superior mapping outcomes in complex scenarios. The effectiveness of our proposed methods is substantiated through experimental evaluation, demonstrating their capability to produce more reliable and precise maps in environments with variable elements. The results indicate improvements in autonomous navigation and mapping, providing a practical solution for SLAM in challenging and dynamic settings.

A Novel Multidimensional Tensile, Shear, and Buckling Sensor for the Measurement of Flexible Fibrous Materials.

To meet the complex and diverse demands for low-stress mechanical measurements of fabrics and other flexible materials, two integrated multidimensional force sensors with the same structure but different ranges were explored. They can support both rapid and precise low-noise, high-precision, low-cost, easy-to-use, reliable, and intelligent solutions for the complex measurement of fabric mechanics. Having analysed the mechanical relationship of the parallel beam theory, and considering the specific requirements of fabric measurement, a novel multi-dimensional force sensor is designed, capable of measuring tensile, shear, and buckling properties. Finite element analysis is used to simulate the mechanical performance of this sensor for fabric-loading/unloading measurement, and the sensitivity of the mechanical quantity transfer, the amount of sensor deformation, the stress distribution, and the degree of inter-dimensional coupling have been investigated and verified. The basis for subsequent digital processing is achieved by a low-offset, low-temperature-drift, low-power-consumption analogue front end, 24-bit ADC circuit, and signal conditioning electronics, suitable for the measurement of fabric mechanics under low stress, which is like the end-user requirements. The sensor information channel is supported by a host microcontroller with a DSP and a floating-point processing instruction set. Information processing is performed in time-sharing with the support of a multitasking real-time operating system. The purpose of designing this sensor is to facilitate the development of a new testing instrument, which will adopt the advances of current instruments whilst eliminating their shortcomings.

Hybrid Multimodal Feature Fusion with Multi-Sensor for Bearing Fault Diagnosis.

Aiming at the traditional single sensor vibration signal cannot fully express the bearing running state, and in the high noise background, the traditional algorithm is insufficient for fault feature extraction. This paper proposes a fault diagnosis algorithm based on multi-sensor and hybrid multimodal feature fusion to achieve high-precision fault diagnosis by leveraging the operating state information of bearings in a high-noise environment to the fullest extent possible. First, the horizontal and vertical vibration signals from two sensors are fused using principal component analysis, aiming to provide a more comprehensive description of the bearing's operating condition, followed by data set segmentation. Following fusion, time-frequency feature maps are generated using a continuous wavelet transform for global time-frequency feature extraction. A first diagnostic model is then developed utilizing a residual neural network. Meanwhile, the feature data is normalized, and 28 time-frequency feature indexes are extracted. Subsequently, a second diagnostic model is constructed using a support vector machine. Lastly, the two diagnosis models are integrated to derive the final model through an ensemble learning algorithm fused at the decision level and complemented by a genetic algorithm solution to improve the diagnosis accuracy. Experimental results demonstrate the effectiveness of the proposed algorithm in achieving superior diagnostic performance with a 97.54% accuracy rate.

Research on a Visual/Ultra-Wideband Tightly Coupled Fusion Localization Algorithm.

In the autonomous navigation of mobile robots, precise positioning is crucial. In forest environments with weak satellite signals or in sites disturbed by complex environments, satellite positioning accuracy has difficulty in meeting the requirements of autonomous navigation positioning accuracy for robots. This article proposes a vision SLAM/UWB tightly coupled localization method and designs a UWB non-line-of-sight error identification method using the displacement increment of the visual odometer. It utilizes the displacement increment of visual output and UWB ranging information as measurement values and applies the extended Kalman filtering algorithm for data fusion. This study utilized the constructed experimental platform to collect images and ultra-wideband ranging data in outdoor environments and experimentally validated the combined positioning method. The experimental results show that the algorithm outperforms individual UWB or loosely coupled combination positioning methods in terms of positioning accuracy. It effectively eliminates non-line-of-sight errors in UWB, improving the accuracy and stability of the combined positioning system.

Distributed Consensus Estimation for Networked Multi-Sensor Systems under Hybrid Attacks and Missing Measurements.

Cyber-security research on networked multi-sensor systems is crucial due to the vulnerability to various types of cyberattacks. For the development of effective defense measures, attention is required to gain insight into the complex characteristics and behaviors of cyber attacks from the attacker's perspective. This paper aims to tackle the problem of distributed consensus estimation for networked multi-sensor systems subject to hybrid attacks and missing measurements. To account for both random denial of service (DoS) attacks and false data injection (FDI) attacks, a hybrid attack model on the estimator-to-estimator communication channel is presented. The characteristics of missing measurements are defined by random variables that satisfy the Bernoulli distribution. Then a modified consensus-based distributed estimator, integrated with the characteristics of hybrid attacks and missing measurements, is presented. For reducing the computational complexity of the optimal distributed estimation method, a scalable suboptimal distributed consensus estimator is designed. Sufficient conditions are further provided for guaranteeing the stability of the proposed suboptimal distributed estimator. Finally, a simulation experiment on aircraft tracking is executed to validate the effectiveness and feasibility of the proposed algorithm.

Robust Detection of Critical Events in the Context of Railway Security Based on Multimodal Sensor Data Fusion.

Effective security surveillance is crucial in the railway sector to prevent security incidents, including vandalism, trespassing, and sabotage. This paper discusses the challenges of maintaining seamless surveillance over extensive railway infrastructure, considering both technological advances and the growing risks posed by terrorist attacks. Based on previous research, this paper discusses the limitations of current surveillance methods, particularly in managing information overload and false alarms that result from integrating multiple sensor technologies. To address these issues, we propose a new fusion model that utilises Probabilistic Occupancy Maps (POMs) and Bayesian fusion techniques. The fusion model is evaluated on a comprehensive dataset comprising three use cases with a total of eight real life critical scenarios. We show that, with this model, the detection accuracy can be increased while simultaneously reducing the false alarms in railway security surveillance systems. This way, our approach aims to enhance situational awareness and reduce false alarms, thereby improving the effectiveness of railway security measures.

Multi-Tracking Sensor Architectures for Reconstructing Autonomous Vehicle Crashes: An Exploratory Study.

With the continuous development of new sensor features and tracking algorithms for object tracking, researchers have opportunities to experiment using different combinations. However, there is no standard or agreed method for selecting an appropriate architecture for autonomous vehicle (AV) crash reconstruction using multi-sensor-based sensor fusion. This study proposes a novel simulation method for tracking performance evaluation (SMTPE) to solve this problem. The SMTPE helps select the best tracking architecture for AV crash reconstruction. This study reveals that a radar-camera-based centralized tracking architecture of multi-sensor fusion performed the best among three different architectures tested with varying sensor setups, sampling rates, and vehicle crash scenarios. We provide a brief guideline for the best practices in selecting appropriate sensor fusion and tracking architecture arrangements, which can be helpful for future vehicle crash reconstruction and other AV improvement research.

Multi-Sensor-Assisted Low-Cost Indoor Non-Visual Semantic Map Construction and Localization for Modern Vehicles.

With the transformation and development of the automotive industry, low-cost and seamless indoor and outdoor positioning has become a research hotspot for modern vehicles equipped with in-vehicle infotainment systems, Internet of Vehicles, or other intelligent systems (such as Telematics Box, Autopilot, etc.). This paper analyzes modern vehicles in different configurations and proposes a low-cost, versatile indoor non-visual semantic mapping and localization solution based on low-cost sensors. Firstly, the sliding window-based semantic landmark detection method is designed to identify non-visual semantic landmarks (e.g., entrance/exit, ramp entrance/exit, road node). Then, we construct an indoor non-visual semantic map that includes the vehicle trajectory waypoints, non-visual semantic landmarks, and Wi-Fi fingerprints of RSS features. Furthermore, to estimate the position of modern vehicles in the constructed semantic maps, we proposed a graph-optimized localization method based on landmark matching that exploits the correlation between non-visual semantic landmarks. Finally, field experiments are conducted in two shopping mall scenes with different underground parking layouts to verify the proposed non-visual semantic mapping and localization method. The results show that the proposed method achieves a high accuracy of 98.1% in non-visual semantic landmark detection and a low localization error of 1.31 m.

TS-LCD: Two-Stage Loop-Closure Detection Based on Heterogeneous Data Fusion.

Loop-closure detection plays a pivotal role in simultaneous localization and mapping (SLAM). It serves to minimize cumulative errors and ensure the overall consistency of the generated map. This paper introduces a multi-sensor fusion-based loop-closure detection scheme (TS-LCD) to address the challenges of low robustness and inaccurate loop-closure detection encountered in single-sensor systems under varying lighting conditions and structurally similar environments. Our method comprises two innovative components: a timestamp synchronization method based on data processing and interpolation, and a two-order loop-closure detection scheme based on the fusion validation of visual and laser loops. Experimental results on the publicly available KITTI dataset reveal that the proposed method outperforms baseline algorithms, achieving a significant average reduction of 2.76% in the trajectory error (TE) and a notable decrease of 1.381 m per 100 m in the relative error (RE). Furthermore, it boosts loop-closure detection efficiency by an average of 15.5%, thereby effectively enhancing the positioning accuracy of odometry.

Dynamic Validation of Calibration Accuracy and Structural Robustness of a Multi-Sensor Mobile Robot.

For mobile robots, the high-precision integrated calibration and structural robustness of multi-sensor systems are important prerequisites for ensuring healthy operations in the later stage. Currently, there is no well-established validation method for the calibration accuracy and structural robustness of multi-sensor systems, especially for dynamic traveling situations. This paper presents a novel validation method for the calibration accuracy and structural robustness of a multi-sensor mobile robot. The method employs a ground-object-air cooperation mechanism, termed the "ground surface simulation field (GSSF)-mobile robot -photoelectric transmitter station (PTS)". Firstly, a static high-precision GSSF is established with the true north datum as a unified reference. Secondly, a rotatable synchronous tracking system (PTS) is assembled to conduct real-time pose measurements for a mobile vehicle. The relationship between each sensor and the vehicle body is utilized to measure the dynamic pose of each sensor. Finally, the calibration accuracy and structural robustness of the sensors are dynamically evaluated. In this context, epipolar line alignment is employed to assess the accuracy of the evaluation of relative orientation calibration of binocular cameras. Point cloud projection and superposition are utilized to realize the evaluation of absolute calibration accuracy and structural robustness of individual sensors, including the navigation camera (Navcam), hazard avoidance camera (Hazcam), multispectral camera, time-of-flight depth camera (TOF), and light detection and ranging (LiDAR), with respect to the vehicle body. The experimental results demonstrate that the proposed method offers a reliable means of dynamic validation for the testing phase of a mobile robot.

A Survey on Multi-Sensor Fusion Perimeter Intrusion Detection in High-Speed Railways.

In recent years, the safety issues of high-speed railways have remained severe. The intrusion of personnel or obstacles into the perimeter has often occurred in the past, causing derailment or parking, especially in the case of bad weather such as fog, haze, rain, etc. According to previous research, it is difficult for a single sensor to meet the application needs of all scenario, all weather, and all time domains. Due to the complementary advantages of multi-sensor data such as images and point clouds, multi-sensor fusion detection technology for high-speed railway perimeter intrusion is becoming a research hotspot. To the best of our knowledge, there has been no review of research on multi-sensor fusion detection technology for high-speed railway perimeter intrusion. To make up for this deficiency and stimulate future research, this article first analyzes the situation of high-speed railway technical defense measures and summarizes the research status of single sensor detection. Secondly, based on the analysis of typical intrusion scenarios in high-speed railways, we introduce the research status of multi-sensor data fusion detection algorithms and data. Then, we discuss risk assessment of railway safety. Finally, the trends and challenges of multi-sensor fusion detection algorithms in the railway field are discussed. This provides effective theoretical support and technical guidance for high-speed rail perimeter intrusion monitoring.

Development of an Underwater Adaptive Penetration System for In Situ Monitoring of Marine Engineering Geology.

In recent years, offshore wind farms have frequently encountered engineering geological disasters such as seabed liquefaction and scouring. Consequently, in situ monitoring has become essential for the safe siting, construction, and operation of these installations. Current technologies are hampered by limitations in single-parameter monitoring and insufficient probe-penetration depth, hindering comprehensive multi-parameter dynamic monitoring of seabed sediments. To address these challenges, we propose a foldable multi-sensor probe and establish an underwater adaptive continuous penetration system capable of concurrently measuring seabed elevation changes and sediment pore water pressure profiles. The reliability of the equipment design is confirmed through static analysis of the frame structure and sealed cabin. Furthermore, laboratory tests validate the stability and accuracy of the electrical and mechanical sensor measurements. Preliminary tests conducted in a harbor environment demonstrate the system's effectiveness.

Research on Positioning and Navigation System of Greenhouse Mobile Robot Based on Multi-Sensor Fusion.

The labor shortage and rising costs in the greenhouse industry have driven the development of automation, with the core of autonomous operations being positioning and navigation technology. However, precise positioning in complex greenhouse environments and narrow aisles poses challenges to localization technologies. This study proposes a multi-sensor fusion positioning and navigation robot based on ultra-wideband (UWB), an inertial measurement unit (IMU), odometry (ODOM), and a laser rangefinder (RF). The system introduces a confidence optimization algorithm based on weakening non-line-of-sight (NLOS) for UWB positioning, obtaining calibrated UWB positioning results, which are then used as a baseline to correct the positioning errors generated by the IMU and ODOM. The extended Kalman filter (EKF) algorithm is employed to fuse multi-sensor data. To validate the feasibility of the system, experiments were conducted in a Chinese solar greenhouse. The results show that the proposed NLOS confidence optimization algorithm significantly improves UWB positioning accuracy by 60.05%. At a speed of 0.1 m/s, the root mean square error (RMSE) for lateral deviation is 0.038 m and for course deviation is 4.030°. This study provides a new approach for greenhouse positioning and navigation technology, achieving precise positioning and navigation in complex commercial greenhouse environments and narrow aisles, thereby laying a foundation for the intelligent development of greenhouses.

Research on Corn Leaf and Stalk Recognition and Ranging Technology Based on LiDAR and Camera Fusion.

Corn, as one of the three major grain crops in China, plays a crucial role in ensuring national food security through its yield and quality. With the advancement of agricultural intelligence, agricultural robot technology has gained significant attention. High-precision navigation is the basis for realizing various operations of agricultural robots in corn fields and is closely related to the quality of operations. Corn leaf and stalk recognition and ranging are the prerequisites for achieving high-precision navigation and have attracted much attention. This paper proposes a corn leaf and stalk recognition and ranging algorithm based on multi-sensor fusion. First, YOLOv8 is used to identify corn leaves and stalks. Considering the large differences in leaf morphology and the large changes in field illumination that lead to discontinuous identification, an equidistant expansion polygon algorithm is proposed to post-process the leaves, thereby increasing the average recognition completeness of the leaves to 86.4%. Secondly, after eliminating redundant point clouds, the IMU data are used to calculate the confidence of the LiDAR and depth camera ranging point clouds, and point cloud fusion is performed based on this to achieve high-precision ranging of corn leaves. The average ranging error is 2.9 cm, which is lower than the measurement error of a single sensor. Finally, the stalk point cloud is processed and clustered using the FILL-DBSCAN algorithm to identify and measure the distance of the same corn stalk. The algorithm combines recognition accuracy and ranging accuracy to meet the needs of robot navigation or phenotypic measurement in corn fields, ensuring the stable and efficient operation of the robot in the corn field.

Interval Split Covariance Intersection Filter: Theory and Its Application to Cooperative Localization in a Multi-Sensor Multi-Vehicle System.

The data incest problem causes inter-estimate correlation during data fusion processes, which yields inconsistent data fusion results. Especially in the multi-sensor multi-vehicle (MSMV) system, the data incest problem is serious due to multiple relative position estimations, which not only lead to pessimistic estimation but also cause additional computational overhead. In order to address the data incest problem, we propose a new data fusion method termed the interval split covariance intersection filter (ISCIF). The general consistency of the ISCIF is proven, serving as supplementary proof for the split covariance intersection filter (SCIF). Moreover, a decentralized MSMV localization system including absolute and relative positioning stages is designed. In the absolute positioning stage, each vehicle uses the ISCIF algorithm to update its own position based on absolute measurements. In the relative position stage, the interval constraint propagation (ICP) method is implemented to preprocess multiple relative position estimates and initially prepare input data for ISCIF. Then, the proposed ISCIF algorithm is employed to realize relative positioning. In addition, comparative simulations demonstrate that the proposed method can achieve both accurate and consistent results compared with the state-of-the-art methods.