Methodology to filter out outliers in high spatial density data to improve maps reliability

The considerable volume of data generated by sensors in the field presents systematic errors; thus, it is extremely important to exclude these errors to ensure mapping quality. The objective of this research was to develop and test a methodology to identify and exclude outliers in high-density spatial data sets, determine whether the developed filter process could help decrease the nugget effect and improve the spatial variability characterization of high sampling data. We created a filter composed of a global, anisotropic, and an anisotropic local analysis of data, which considered the respective neighborhood values. For that purpose, we used the median to classify a given spatial point into the data set as the main statistical parameter and took into account its neighbors within a radius. The filter was tested using raw data sets of corn yield, soil electrical conductivity (ECa), and the sensor vegetation index (SVI) in sugarcane. The results showed an improvement in accuracy of spatial variability within the data sets. The methodology reduced RMSE by 85 %, 97 %, and 79 % in corn yield, soil ECa, and SVI respectively, compared to interpolation errors of raw data sets. The filter excluded the local outliers, which considerably reduced the nugget effects, reducing estimation error of the interpolated data. The methodology proposed in this work had a better performance in removing outlier data when compared to two other methodologies from the literature.

Methodology to filter out outliers in high spatial density data to improve maps reliability

The considerable volume of data generated by sensors in the field presents systematic errors; thus, it is extremely important to exclude these errors to ensure mapping quality. The objective of this research was to develop and test a methodology to identify and exclude outliers in high-density spatial data sets, determine whether the developed filter process could help decrease the nugget effect and improve the spatial variability characterization of high sampling data. We created a filter composed of a global, anisotropic, and an anisotropic local analysis of data, which considered the respective neighborhood values. For that purpose, we used the median to classify a given spatial point into the data set as the main statistical parameter and took into account its neighbors within a radius. The filter was tested using raw data sets of corn yield, soil electrical conductivity (ECa), and the sensor vegetation index (SVI) in sugarcane. The results showed an improvement in accuracy of spatial variability within the data sets. The methodology reduced RMSE by 85 %, 97 %, and 79 % in corn yield, soil ECa, and SVI respectively, compared to interpolation errors of raw data sets. The filter excluded the local outliers, which considerably reduced the nugget effects, reducing estimation error of the interpolated data. The methodology proposed in this work had a better performance in removing outlier data when compared to two other methodologies from the literature.(AU)

Methodology to filter out outliers in high spatial density data to improve maps reliability

ABSTRACT The considerable volume of data generated by sensors in the field presents systematic errors; thus, it is extremely important to exclude these errors to ensure mapping quality. The objective of this research was to develop and test a methodology to identify and exclude outliers in high-density spatial data sets, determine whether the developed filter process could help decrease the nugget effect and improve the spatial variability characterization of high sampling data. We created a filter composed of a global, anisotropic, and an anisotropic local analysis of data, which considered the respective neighborhood values. For that purpose, we used the median to classify a given spatial point into the data set as the main statistical parameter and took into account its neighbors within a radius. The filter was tested using raw data sets of corn yield, soil electrical conductivity (ECa), and the sensor vegetation index (SVI) in sugarcane. The results showed an improvement in accuracy of spatial variability within the data sets. The methodology reduced RMSE by 85 %, 97 %, and 79 % in corn yield, soil ECa, and SVI respectively, compared to interpolation errors of raw data sets. The filter excluded the local outliers, which considerably reduced the nugget effects, reducing estimation error of the interpolated data. The methodology proposed in this work had a better performance in removing outlier data when compared to two other methodologies from the literature.

A statistical approach to static and dynamic tests for Global Navigation Satellite Systems receivers used in agricultural operations

The adaptation of the Global Navigation Satellite Systems (GNSS) technology to fit the needs of farmers requires knowledge of the accuracy level delivered by a GNSS receiver in working conditions. To date, no methodology indicates the minimum number of replications to perform a statistical comparison. This study aims to advance knowledge on the methodological approach for evaluating the static and dynamic performance of GNSS receivers commonly used in agricultural operations. For the static test, a supporting frame in the ground carried all the receivers with coordinates properly transported. In the dynamic test, a circular rail with a 9.55 m radius was installed at ground level with a platform driven by an electric motor to carry the receivers at a constant speed. The transversal error of the receiver to the circular reference line was measured. The error with 95 % probability (E95) to receivers without differential correction ranged between 4.22 m and 0.85 m in the static test, and 2.25 m and 0.98 m in the dynamic test. Receivers with differential correction had E95 values below 0.10 m in the static test and 0.16 m in the dynamic test. Receivers with C/A code require five replications at minimum and 13 replications are needed for L1/L2 with differential correction signals in the dynamic test. The static test needs nine replications for C/A and five for L1/L2 with differential correction signals.(AU)

A statistical approach to static and dynamic tests for Global Navigation Satellite Systems receivers used in agricultural operations

The adaptation of the Global Navigation Satellite Systems (GNSS) technology to fit the needs of farmers requires knowledge of the accuracy level delivered by a GNSS receiver in working conditions. To date, no methodology indicates the minimum number of replications to perform a statistical comparison. This study aims to advance knowledge on the methodological approach for evaluating the static and dynamic performance of GNSS receivers commonly used in agricultural operations. For the static test, a supporting frame in the ground carried all the receivers with coordinates properly transported. In the dynamic test, a circular rail with a 9.55 m radius was installed at ground level with a platform driven by an electric motor to carry the receivers at a constant speed. The transversal error of the receiver to the circular reference line was measured. The error with 95 % probability (E95) to receivers without differential correction ranged between 4.22 m and 0.85 m in the static test, and 2.25 m and 0.98 m in the dynamic test. Receivers with differential correction had E95 values below 0.10 m in the static test and 0.16 m in the dynamic test. Receivers with C/A code require five replications at minimum and 13 replications are needed for L1/L2 with differential correction signals in the dynamic test. The static test needs nine replications for C/A and five for L1/L2 with differential correction signals.

Data processing within rows for sugarcane yield mapping

The mapping of sugarcane yield is still not as widely available as it is for grain crops. Sugarcane harvesters cut and process the cane in a single or maximum of two rows, facilitating the monitoring of cane yield and its behavior on a small scale. This study tested a method for sugarcane yield data cleaning, investigating if the data recording frequency influences the characterization of yield variations in mapping high-resolution spatial data within a single row. Four data sets from yield monitors of single row harvesting were used. A cleaning process with global and anisotropic filtering in a single sugarcane row was applied. The local outlier cleaner compares the yield value of a point with its nearest neighbors within the same row. Even after the elimination of outliers, there is great variation in yield between the rows, and this variation is much smaller in a single row. A frequency of 2 Hz was required for identifying and characterizing small yield variations within the sugarcane rows whilst other frequencies tried (0.2 and 0.1 Hz) resulted in loss of information on yield variability within the row. The difference between the root mean square error (RMSE) of ordinary kriging (OK) and inverse distance weighting (IDW) techniques is large enough to suggest the use of an individual yield line. Individual yield lines saved information in the data generated by the yield monitor unlike IDW and OK interpolation methods which omitted information over short distances within the rows and compromised the quality of high-resolution maps.

Data processing within rows for sugarcane yield mapping

The mapping of sugarcane yield is still not as widely available as it is for grain crops. Sugarcane harvesters cut and process the cane in a single or maximum of two rows, facilitating the monitoring of cane yield and its behavior on a small scale. This study tested a method for sugarcane yield data cleaning, investigating if the data recording frequency influences the characterization of yield variations in mapping high-resolution spatial data within a single row. Four data sets from yield monitors of single row harvesting were used. A cleaning process with global and anisotropic filtering in a single sugarcane row was applied. The local outlier cleaner compares the yield value of a point with its nearest neighbors within the same row. Even after the elimination of outliers, there is great variation in yield between the rows, and this variation is much smaller in a single row. A frequency of 2 Hz was required for identifying and characterizing small yield variations within the sugarcane rows whilst other frequencies tried (0.2 and 0.1 Hz) resulted in loss of information on yield variability within the row. The difference between the root mean square error (RMSE) of ordinary kriging (OK) and inverse distance weighting (IDW) techniques is large enough to suggest the use of an individual yield line. Individual yield lines saved information in the data generated by the yield monitor unlike IDW and OK interpolation methods which omitted information over short distances within the rows and compromised the quality of high-resolution maps.(AU)