Detecting Technical Anomalies in High-Frequency Water-Quality Data Using Artificial Neural Networks.

Anomaly detection (AD) in high-volume environmental data requires one to tackle a series of challenges associated with the typical low frequency of anomalous events, the broad-range of possible anomaly types, and local nonstationary environmental conditions, suggesting the need for flexible statistical methods that are able to cope with unbalanced high-volume data problems. Here, we aimed to detect anomalies caused by technical errors in water-quality (turbidity and conductivity) data collected by automated in situ sensors deployed in contrasting riverine and estuarine environments. We first applied a range of artificial neural networks that differed in both learning method and hyperparameter values, then calibrated models using a Bayesian multiobjective optimization procedure, and selected and evaluated the "best" model for each water-quality variable, environment, and anomaly type. We found that semi-supervised classification was better able to detect sudden spikes, sudden shifts, and small sudden spikes, whereas supervised classification had higher accuracy for predicting long-term anomalies associated with drifts and periods of otherwise unexplained high variability.

Spatially balanced sampling designs for environmental surveys.

Some environmental studies use non-probabilistic sampling designs to draw samples from spatially distributed populations. Unfortunately, these samples can be difficult to analyse statistically and can give biased estimates of population characteristics. Spatially balanced sampling designs are probabilistic designs that spread the sampling effort evenly over the resource. These designs are particularly useful for environmental sampling because they produce good-sample coverage over the resource, they have precise design-based estimators and they can potentially reduce the sampling cost. The most popular spatially balanced design is Generalized Random Tessellation Stratified (GRTS), which has many desirable features including a spatially balanced sample, design-based estimators and the ability to select spatially balanced oversamples. This article considers the popularity of spatially balanced sampling, reviews several spatially balanced sampling designs and shows how these designs can be implemented in the statistical programming language R. We hope to increase the visibility of spatially balanced sampling and encourage environmental scientists to use these designs.

Elucidating the daily foraging activity pattern of Oecophylla smaragdina to minimize bite nuisances in Asia large agro-system plantations.

Oecophylla smaragdina F., the Asian weaver ant, is one of the oil palm plantation's (Elaeis guineensis) potential predators, for the invasive bagworm species Metisa plana Walker, but this ant is a nuisance species that irritates plantation workers with their sharp bites. Here we assess the foraging activities (FA) of O. smaragdina's major workers, identify its inactive times and the existence of supervision, a novelty for social insects. Between 2018 and 2022, the pattern of trunk foraging activity was used as a mitigation measure. The relationship between trunk FA and air temperature (AT), relative humidity (RH), air pressure (AP), and rainfall interception (RI) was also investigated. Our results showed that, O. smaragdina is a strictly diurnal ant species, has little to no crepuscular activity, and stopped foraging during darkness. Moreover, veteran bigger workers systematically acted as supervisors by monitoring trails, intercepting, and bringing back to nests smaller individuals during heat peaks. In relation to population size relative abundance, all colonies displayed greater intensity during the warmest daily periods with higher mean forager density among the bigger colony, regardless of the dry-rainy intervals corresponded to minimal activity from late scotophase to early photophase and showed a bimodal pattern. Thus, forager activity peaked between 1100-1530 h and 1745-1845 h, and an average two-fold daily sudden decrease in intensity between 1620 and 1650 h as a partial cut-off period (first report). Furthermore, foraging activity, AT, AP showed a significant positive correlation while RH was negative. Finally, we found that from the base palm trunks, defensive territorial layers extended to 5 m on average with different spatial configurations indicating greater foraging density within the first 2 m. Our study shows O. smaragdina daily low activity periods, before 1000 h, being the most suitable to avoid forager attacks to facilitate pruning and harvesting tasks.

Understanding links between water-quality variables and nitrate concentration in freshwater streams using high frequency sensor data.

Real-time monitoring using in-situ sensors is becoming a common approach for measuring water-quality within watersheds. High-frequency measurements produce big datasets that present opportunities to conduct new analyses for improved understanding of water-quality dynamics and more effective management of rivers and streams. Of primary importance is enhancing knowledge of the relationships between nitrate, one of the most reactive forms of inorganic nitrogen in the aquatic environment, and other water-quality variables. We analysed high-frequency water-quality data from in-situ sensors deployed in three sites from different watersheds and climate zones within the National Ecological Observatory Network, USA. We used generalised additive mixed models to explain the nonlinear relationships at each site between nitrate concentration and conductivity, turbidity, dissolved oxygen, water temperature, and elevation. Temporal auto-correlation was modelled with an auto-regressive-moving-average (ARIMA) model and we examined the relative importance of the explanatory variables. Total deviance explained by the models was high for all sites (99%). Although variable importance and the smooth regression parameters differed among sites, the models explaining the most variation in nitrate contained the same explanatory variables. This study demonstrates that building a model for nitrate using the same set of explanatory water-quality variables is achievable, even for sites with vastly different environmental and climatic characteristics. Applying such models will assist managers to select cost-effective water-quality variables to monitor when the goals are to gain a spatial and temporal in-depth understanding of nitrate dynamics and adapt management plans accordingly.

Reconstructing Missing and Anomalous Data Collected from High-Frequency In-Situ Sensors in Fresh Waters.

In situ sensors that collect high-frequency data are used increasingly to monitor aquatic environments. These sensors are prone to technical errors, resulting in unrecorded observations and/or anomalous values that are subsequently removed and create gaps in time series data. We present a framework based on generalized additive and auto-regressive models to recover these missing data. To mimic sporadically missing (i) single observations and (ii) periods of contiguous observations, we randomly removed (i) point data and (ii) day- and week-long sequences of data from a two-year time series of nitrate concentration data collected from Arikaree River, USA, where synoptically collected water temperature, turbidity, conductance, elevation, and dissolved oxygen data were available. In 72% of cases with missing point data, predicted values were within the sensor precision interval of the original value, although predictive ability declined when sequences of missing data occurred. Precision also depended on the availability of other water quality covariates. When covariates were available, even a sudden, event-based peak in nitrate concentration was reconstructed well. By providing a promising method for accurate prediction of missing data, the utility and confidence in summary statistics and statistical trends will increase, thereby assisting the effective monitoring and management of fresh waters and other at-risk ecosystems.