UAV-UGV Collaborative Localisation with Minimum Sensing.

This paper presents a novel methodology to localise Unmanned Ground Vehicles (UGVs) using Unmanned Aerial Vehicles (UAVs). The UGVs are assumed to be operating in a Global Navigation Satellite System (GNSS)-denied environment. The localisation of the ground vehicles is achieved using UAVs that have full access to the GNSS. The UAVs use range sensors to localise the UGV. One of the major requirements is to use the minimum number of UAVs, which is two UAVs in this paper. Using only two UAVs leads to a significant complication that results an estimation unobservability under certain circumstances. As a solution to the unobservability problem, the main contribution of this paper is to present a methodology to treat the unobservability problem. A Constrained Extended Kalman Filter (CEKF)-based solution, which uses novel kinematics and heuristics-based constraints, is presented. The proposed methodology has been assessed based on the stochastic observability using the Posterior Cramér-Rao Bound (PCRB), and the results demonstrate the successful operation of the proposed localisation method.

Low-Cost Plant-Protection Unmanned Ground Vehicle System for Variable Weeding Using Machine Vision.

This study presents a machine vision-based variable weeding system for plant- protection unmanned ground vehicles (UGVs) to address the issues of pesticide waste and environmental pollution that are readily caused by traditional spraying agricultural machinery. The system utilizes fuzzy rules to achieve adaptive modification of the Kp, Ki, and Kd adjustment parameters of the PID control algorithm and combines them with an interleaved period PWM controller to reduce the impact of nonlinear variations in water pressure on the performance of the system, and to improve the stability and control accuracy of the system. After testing various image threshold segmentation and image graying algorithms, the normalized super green algorithm (2G-R-B) and the fast iterative threshold segmentation method were adopted as the best combination. This combination effectively distinguished between the vegetation and the background, and thus improved the accuracy of the pixel extraction algorithm for vegetation distribution. The results of orthogonal testing by selected four representative spraying duty cycles-25%, 50%, 75%, and 100%-showed that the pressure variation was less than 0.05 MPa, the average spraying error was less than 2%, and the highest error was less than 5% throughout the test. Finally, the performance of the system was comprehensively evaluated through field trials. The evaluation showed that the system was able to adjust the corresponding spraying volume in real time according to the vegetation distribution under the decision-making based on machine vision algorithms, which proved the low cost and effectiveness of the designed variable weed control system.

Impact of Rainfall on the Detection Performance of Non-Contact Safety Sensors for UAVs/UGVs.

This study comprehensively investigates how rain and drizzle affect the object-detection performance of non-contact safety sensors, which are essential for the operation of unmanned aerial vehicles and ground vehicles in adverse weather conditions. In contrast to conventional sensor-performance evaluation based on the amount of precipitation, this paper proposes spatial transmittance and particle density as more appropriate metrics for rain environments. Through detailed experiments conducted under a variety of precipitation conditions, it is shown that sensor performance is significantly affected by the density of small raindrops rather than the total amount of precipitation. This finding challenges traditional sensor-evaluation metrics in rainfall environments and suggests a paradigm shift toward the use of spatial transmittance as a universal metric for evaluating sensor performance in rain, drizzle, and potentially other adverse weather scenarios.

Relative Localization and Circumnavigation of a UGV0 Based on Mixed Measurements of Multi-UAVs by Employing Intelligent Sensors.

Relative localization (RL) and circumnavigation is a highly challenging problem that is crucial for the safe flight of multi-UAVs (multiple unmanned aerial vehicles). Most methods depend on some external infrastructure for positioning. However, in some complex environments such as forests, it is difficult to set up such infrastructures. In this paper, an approach to infrastructure-free RL estimations of multi-UAVs is investigated for circumnavigating a slowly drifting UGV0 (unmanned ground vehicle 0), where UGV0 serves as the RL and circumnavigation target. Firstly, a discrete-time direct RL estimator is proposed to ascertain the coordinates of each UAV relative to the UGV0 based on intelligent sensing. Secondly, an RL fusion estimation method is proposed to obtain the final estimate of UGV0. Thirdly, an integrated estimation control scheme is also proposed for the application of the RL fusion estimation method to circumnavigation. The convergence and the performance are analyzed. The simulation results validate the effectiveness of the proposed algorithm for RL fusion estimations and of the integrated scheme.

Intelligent Traffic Model for Unmanned Ground Vehicles Based on DSDV-AODV Protocol.

Traffic systems have been built as a result of recent technological advancements. In application, dependable communication technology is essential to link any system needs. VANET technology is used to communicate data about intelligent traffic lights, which are focused on infrastructure during traffic accidents and mechanisms to reduce traffic congestion. To ensure reliable data transfer in VANET, appropriate routing protocols must be used. This research aims to improve data transmission in VANETs implemented in intelligent traffic lights. This study investigates the capability of combining the DSDV routing protocol with the routing protocol AODV to boost AODV on an OMNET++ simulator utilizing the 802.11p wireless standard. According to the simulation results obtained by analyzing the delay parameters, network QoS, and throughput on each protocol, the DSDV-AODV routing protocol performs better in three scenarios compared to QoS, delay, and throughput parameters in every scenario that uses network topology adapted to the conditions on the road intersections. The topology with 50 fixed + 50 mobile nodes yields the best results, with 0.00062 s delay parameters, a network QoS of 640 bits/s, and a throughput of 629.437 bits/s. Aside from the poor results on the network QoS parameters, the addition of mobile nodes to the topology influences both the results of delay and throughput metrics.

Research on Kinematic and Static Filtering of the ESKF Based on INS/GNSS/UWB.

With the widespread development of multiple sensors for UGVs, the multi-source fusion-navigation system, which overcomes the limitations of the use of a single sensor, is becoming increasingly important in the field of autonomous navigation for UGVs. Because federated filtering is not independent between the filter-output quantities, owing to the use of the same state equation in each of the local sensors, a new kinematic and static multi-source fusion-filtering algorithm based on the error-state Kalman filter (ESKF) is proposed in this paper for the positioning-state estimation of UGVs. The algorithm is based on INS/GNSS/UWB multi-source sensors, and the ESKF replaces the traditional Kalman filter in kinematic and static filtering. After constructing the kinematic EKSF based on GNSS/INS and the static ESKF based on UWB/INS, the error-state vector solved by the kinematic ESKF was injected and set to zero. On this basis, the kinematic ESKF filter solution was used as the state vector of the static ESKF for the rest of the static filtering in a sequential form. Finally, the last static ESKF filtering solution was used as the integral filtering solution. Through mathematical simulations and comparative experiments, it is demonstrated that the proposed method converges quickly, and the positioning accuracy of the method was improved by 21.98% and 13.03% compared to the loosely coupled GNSS/INS and the loosely coupled UWB/INS navigation methods, respectively. Furthermore, as shown by the error-variation curves, the main performance of the proposed fusion-filtering method was largely influenced by the accuracy and robustness of the sensors in the kinematic ESKF. Furthermore, the algorithm proposed in this paper demonstrated good generalizability, plug-and-play, and robustness through comparative analysis experiments.

Enhanced QoS Routing Protocol for an Unmanned Ground Vehicle, Based on the ACO Approach.

Improving models for managing the networks of firefighting unmanned ground vehicles in crowded areas, as a recommendation system (RS), represented a difficult challenge. This challenge comes from the peculiarities of these types of networks. These networks are distinguished by the network coverage area size, frequent network connection failures, and quick network structure changes. The research aims to improve the communication network of self-driving firefighting unmanned ground vehicles by determining the best routing track to the desired fire area. The suggested new model intends to improve the RS regarding the optimum tracking route for firefighting unmanned ground vehicles by employing the ant colony optimization technique. This optimization method represents one of the swarm theories utilized in vehicles ad-hoc networks and social networks. According to the results, the proposed model can enhance the navigation of self-driving firefighting unmanned ground vehicles towards the fire region, allowing firefighting unmanned ground vehicles to take the shortest routes possible, while avoiding closed roads and traffic accidents. This study aids in the control and management of ad-hoc vehicle networks, vehicles of everything, and the internet of things.

Traversable Region Detection and Tracking for a Sparse 3D Laser Scanner for Off-Road Environments Using Range Images.

This study proposes a method for detecting and tracking traversable regions in off-road conditions for unmanned ground vehicles (UGVs). Off-road conditions, such as rough terrain or fields, present significant challenges for UGV navigation, and detecting and tracking traversable regions is essential to ensure safe and efficient operation. Using a 3D laser scanner and range-image-based approach, a method is proposed for detecting traversable regions under off-road conditions; this is followed by a Bayesian fusion algorithm for tracking the traversable regions in consecutive frames. Our range-image-based traversable-region-detection approach enables efficient processing of point cloud data from a 3D laser scanner, allowing the identification of traversable areas that are safe for the unmanned ground vehicle to drive on. The effectiveness of the proposed method was demonstrated using real-world data collected during UGV operations on rough terrain, highlighting its potential as a solution for improving UGV navigation capabilities in challenging environments.

Advantages in Using Colour Calibration for Orthophoto Reconstruction.

UAVs are sensor platforms increasingly used in precision agriculture, especially for crop and environmental monitoring using photogrammetry. In this work, light drone flights were performed on three consecutive days (with different weather conditions) on an experimental agricultural field to evaluate the photogrammetric performances due to colour calibration. Thirty random reconstructions from the three days and six different areas of the field were performed. The results showed that calibrated orthophotos appeared greener and brighter than the uncalibrated ones, better representing the actual colours of the scene. Parameter reporting errors were always lower in the calibrated reconstructions and the other quantitative parameters were always lower in the non-calibrated ones, in particular, significant differences were observed in the percentage of camera stations on the total number of images and the reprojection error. The results obtained showed that it is possible to obtain better orthophotos, by means of a calibration algorithm, to rectify the atmospheric conditions that affect the image obtained. This proposed colour calibration protocol could be useful when integrated into robotic platforms and sensors for the exploration and monitoring of different environments.

Agrobot Lala-An Autonomous Robotic System for Real-Time, In-Field Soil Sampling, and Analysis of Nitrates.

This paper presents an autonomous robotic system, an unmanned ground vehicle (UGV), for in-field soil sampling and analysis of nitrates. Compared to standard methods of soil analysis it has several advantages: each sample is individually analyzed compared to average sample analysis in standard methods; each sample is georeferenced, providing a map for precision base fertilizing; the process is fully autonomous; samples are analyzed in real-time, approximately 30 min per sample; and lightweight for less soil compaction. The robotic system has several modules: commercial robotic platform, anchoring module, sampling module, sample preparation module, sample analysis module, and communication module. The system is augmented with an in-house developed cloud-based platform. This platform uses satellite images, and an artificial intelligence (AI) proprietary algorithm to divide the target field into representative zones for sampling, thus, reducing and optimizing the number and locations of the samples. Based on this, a task is created for the robot to automatically sample at those locations. The user is provided with an in-house developed smartphone app enabling overview and monitoring of the task, changing the positions, removing and adding of the sampling points. The results of the measurements are uploaded to the cloud for further analysis and the creation of prescription maps for variable rate base fertilization.

Robust Lidar-Inertial Odometry with Ground Condition Perception and Optimization Algorithm for UGV.

Unmanned ground vehicles (UGVs) are making more and more progress in many application scenarios in recent years, such as exploring unknown wild terrain, working in precision agriculture and serving in emergency rescue. Due to the complex ground conditions and changeable surroundings of these unstructured environments, it is challenging for these UGVs to obtain robust and accurate state estimations by using sensor fusion odometry without prior perception and optimization for specific scenarios. In this paper, based on an error-state Kalman filter (ESKF) fusion model, we propose a robust lidar-inertial odometry with a novel ground condition perception and optimization algorithm specifically designed for UGVs. The probability distribution gained from the raw inertial measurement unit (IMU) measurements during a certain time period and the state estimation of ESKF were both utilized to evaluate the flatness of ground conditions in real-time; then, by analyzing the relationship between the current ground condition and the accuracy of the state estimation, the tightly coupled lidar-inertial odometry was dynamically optimized further by adjusting the related parameters of the processing algorithm of the lidar points to obtain robust and accurate ego-motion state estimations of UGVs. The method was validated in various types of environments with changeable ground conditions, and the robustness and accuracy are shown through the consistent accurate state estimation in different ground conditions compared with the state-of-art lidar-inertial odometry systems.

Use of Remote Structural Tap Testing Devices Deployed via Ground Vehicle for Health Monitoring of Transportation Infrastructure.

Transportation infrastructure is an integral part of the world's overall functionality; however, current transportation infrastructure has aged since it was first developed and implemented. Consequently, given its condition, preservation has become a main priority for transportation agencies. Billions of dollars annually are required to maintain the United States' transportation system; however, with limited budgets the prioritization of maintenance and repairs is key. Structural Health Monitoring (SHM) methods can efficiently inform the prioritization of preservation efforts. This paper presents an acoustic monitoring SHM method, deemed tap testing, which is used to detect signs of deterioration in structural/mechanical surfaces through nondestructive means. This method is proposed as a tool to assist bridge inspectors, who already utilize a costly form of SHM methodology when conducting inspections in the field. Challenges arise when it comes to this method of testing, especially when SHM device deployment is done by hand, and when the results are based solely upon a given inspector's abilities. This type of monitoring solution is also, in general, only available to experts, and is associated with special cases that justify their cost. With the creation of a low-cost, cyber-physical system that interrogates and classifies the mechanical health of given surfaces, we lower the cost of SHM, decrease the challenges faced when conducting such tests, and enable communities with a revolutionary solution that is adaptable to their needs. The authors of this paper created and tested a low-cost, interrogating robot that informs users of structural/mechanical defects. This research describes the further development, validation of, and experimentation with, a tap testing device that utilizes remote technology.

Application of Smoothing Spline in Determining the Unmanned Ground Vehicles Route Based on Ultra-Wideband Distance Measurements.

Unmanned ground vehicles (UGVs) are technically complex machines to operate in difficult or dangerous environmental conditions. In recent years, there has been an increase in research on so called "following vehicles". The said concept introduces a guide-an object that sets the route the platform should follow. Afterwards, the role of the UGV is to reproduce the mentioned path. The article is based on the field test results of an outdoor localization subsystem using ultra-wideband technology. It focuses on determining the guide's route using a smoothing spline for constructing a UGV's path planning subsystem, which is one of the stages for implementing a "follow-me" system. It has been shown that the use of a smoothing spline, due to the implemented mathematical model, allows for recreating the guide's path in the event of data decay lasting up to a several seconds. The innovation of this article originates from influencing studies on the smoothing parameter of the estimation errors of the guide's location.

Automatically Annotated Dataset of a Ground Mobile Robot in Natural Environments via Gazebo Simulations.

This paper presents a new synthetic dataset obtained from Gazebo simulations of an Unmanned Ground Vehicle (UGV) moving on different natural environments. To this end, a Husky mobile robot equipped with a tridimensional (3D) Light Detection and Ranging (LiDAR) sensor, a stereo camera, a Global Navigation Satellite System (GNSS) receiver, an Inertial Measurement Unit (IMU) and wheel tachometers has followed several paths using the Robot Operating System (ROS). Both points from LiDAR scans and pixels from camera images, have been automatically labeled into their corresponding object class. For this purpose, unique reflectivity values and flat colors have been assigned to each object present in the modeled environments. As a result, a public dataset, which also includes 3D pose ground-truth, is provided as ROS bag files and as human-readable data. Potential applications include supervised learning and benchmarking for UGV navigation on natural environments. Moreover, to allow researchers to easily modify the dataset or to directly use the simulations, the required code has also been released.

IoT Security and Computation Management on a Multi-Robot System for Rescue Operations Based on a Cloud Framework.

There is a growing body of literature that recognizes the importance of Multi-Robot coordination and Modular Robotics. This work evaluates the secure coordination of an Unmanned Aerial Vehicle (UAV) via a drone simulation in Unity and an Unmanned Ground Vehicle (UGV) as a rover. Each robot is equipped with sensors to gather information to send to a cloud server where all computations are performed. Each vehicle is registered by blockchain ledger-based network security. In addition to these, relevant information and alerts are displayed on a website for the users. The usage of UAV-UGV cooperation allows for autonomous surveillance due to the high vantage field of view. Furthermore, the usage of cloud computation lowers the cost of microcontrollers by reducing their complexity. Lastly, blockchain technology mitigates the security issues related to adversarial or malicious robotic nodes connecting to the cluster and not agreeing to privacy rules and norms.

Enhancing Solid State LiDAR Mapping with a 2D Spinning LiDAR in Urban Scenario SLAM on Ground Vehicles.

Solid-State LiDAR (SSL) takes an increasing share of the LiDAR market. Compared with traditional spinning LiDAR, SSLs are more compact, energy-efficient and cost-effective. Generally, the current study of SSL mapping is limited to adapting existing SLAM algorithms to an SSL sensor. However, compared with spinning LiDARs, SSLs are different in terms of their irregular scan patterns and limited FOV. Directly applying existing SLAM approaches on them often increase the instability of a mapping process. This study proposes a systematic design, which consists of a dual-LiDAR mapping system and a three DOF interpolated six DOF odometry. For dual-LiDAR mapping, this work uses a 2D LiDAR to enhance a 3D SSL performance on a ground vehicle platform. The proposed system takes a 2D LiDAR to preprocess the scanning field into a number of feature sections according to the curvatures on the 2D fraction. Subsequently, this section information is passed to 3D SSL for direction feature selection. Additionally, this work proposes an odometry interpolation method which uses both LiDARs to generate two separated odometries. The proposed odometry interpolation method selectively determines the appropriate odometry information to update the system state under challenging conditions. Experiments are conducted in different scenarios. The results proves that the proposed approach is able to utilise 12 times more corner features from the environment than the comparied method, thus results in a demonstrable improvement in its absolute position error.

The Multi-Gas Sensor for Remote UAV and UGV Missions-Development and Tests.

In this article, we present a versatile gas detector that can operate on an unmanned aerial vehicle (UAV) or unmanned ground vehicle (UGV). The device has six electrochemical modules, which can be selected to measure specific gases, according to the mission requirements. The gas intake is realized by a miniaturized vacuum pump, which provides immediate gas distribution to the sensors and improves a fast response. The measurement data are sent wirelessly to the operator's computer, which continuously stores results and presents them in real time. The 2 m tubing allows measurements to be taken in places that are not directly accessible to the UGV or the UAV. While UAVs significantly enhanced the versatility of sensing applications, point gas detection is challenging due to the downwash effect and gas dilution produced by the rotors. In our work, we demonstrated the method of downwash effect reduction at aerial point gas measurements by applying a long-distance probe, which was kept between the UAV and the examined object. Moreover, we developed a safety connection protecting the UAV and sensor in case of accidental jamming of the tubing inside the examined cavity. The methods presented provide an effective gas metering strategy using UAVs.

Methodology of Using Terrain Passability Maps for Planning the Movement of Troops and Navigation of Unmanned Ground Vehicles.

The determination of the route of movement is a key factor which enables navigation. In this article, the authors present the methodology of using different resolution terrain passability maps to generate graphs, which allow for the determination of the optimal route between two points. The routes are generated with the use of two commonly used pathfinding algorithms: Dijkstra's and A-star. The proposed methodology allows for the determination of routes in various variants-A more secure route that avoids all terrain obstacles with a wide curve, or a shorter route, which is, however, more difficult to pass. In order to achieve that, two functions that modify the value of the index of passability (IOP), which is assigned to the primary fields that the passability map consists of, have been used. These functions have a ß parameter that augments or reduces the impact of the applied function on IOP values. The paper also shows the possibilities of implementation of the methodology for the movement of single vehicles or unmanned ground vehicles (UGVs) by using detailed maps as well as for determining routes for large military operational units moving in a 1 km wide corridor. The obtained results show that the change in ß value causes the change of a course of the route as expected and that Dijkstra's algorithm is more stable and slightly faster than A-star. The area of application of the presented methodology is very wide because, except for planning the movement of unmanned ground vehicles or military units of different sizes, it can be used in crisis management, where the possibility of reaching the area outside the road network can be of key importance for the success of the salvage operation.

Sensors and Measurements for Unmanned Systems: An Overview.

The advance of technology has enabled the development of unmanned systems/vehicles used in the air, on the ground or on/in the water. The application range for these systems is continuously increasing, and unmanned platforms continue to be the subject of numerous studies and research contributions. This paper deals with the role of sensors and measurements in ensuring that unmanned systems work properly, meet the requirements of the target application, provide and increase their navigation capabilities, and suitably monitor and gain information on several physical quantities in the environment around them. Unmanned system types and the critical environmental factors affecting their performance are discussed. The measurements that these kinds of vehicles can carry out are presented and discussed, while also describing the most frequently used on-board sensor technologies, as well as their advantages and limitations. The paper provides some examples of sensor specifications related to some current applications, as well as describing the recent research contributions in the field.

A Review of Insect Monitoring Approaches with Special Reference to Radar Techniques.

Drastic declines in insect populations are a vital concern worldwide. Despite widespread insect monitoring, the significant gaps in the literature must be addressed. Future monitoring techniques must be systematic and global. Advanced technologies and computer solutions are needed. We provide here a review of relevant works to show the high potential for solving the aforementioned problems. Major historical and modern methods of insect monitoring are considered. All major radar solutions are carefully reviewed. Insect monitoring with radar is a well established technique, but it is still a fast-growing topic. The paper provides an updated classification of insect radar sets. Three main groups of insect radar solutions are distinguished: scanning, vertical-looking, and harmonic. Pulsed radar sets are utilized for all three groups, while frequency-modulated continuous-wave (FMCW) systems are applied only for vertical-looking and harmonic insect radar solutions. This work proves the high potential of radar entomology based on the growing research interest, along with the emerging novel setups, compact devices, and data processing approaches. The review exposes promising insect monitoring solutions using compact radar instruments. The proposed compact and resource-effective setups can be very beneficial for systematic insect monitoring.