Data formats and standards for opportunistic rainfall sensors.

Opportunistic sensors are increasingly used for rainfall measurement. However, their raw data are collected by a variety of systems that are often not primarily intended for rainfall monitoring, resulting in a plethora of different data formats and a lack of common standards. This hinders the sharing of opportunistic sensing (OS) data, their automated processing, and, at the end, their practical usage and integration into standard observation systems. This paper summarises the experiences of the more than 100 members of the OpenSense Cost Action involved in the OS of rainfall. We review the current practice of collecting and storing precipitation OS data and corresponding metadata, and propose new common guidelines describing the requirements on data and metadata collection, harmonising naming conventions, and defining human-readable and machine readable file formats for data and metadata storage. We focus on three sensors identified by the OpenSense community as prominent representatives of the OS of precipitation: Commercial microwave links (CML): fixed point-to-point radio links mainly used as backhauling connections in telecommunication networks Satellite microwave links (SML): radio links between geostationary Earth orbit (GEO) satellites and ground user terminals. Personal weather stations (PWS): non-professional meteorological sensors owned by citizens. The conventions presented in this paper are primarily designed for storing, handling, and sharing historical time series and do not consider specific requirements for using OS data in real time for operational purposes. The conventions are already now accepted by the ever growing OpenSense community and represent an important step towards automated processing of OS raw data and community development of joint OS software packages.

Opportunistic sensors, devices primarily intended not intended for sensing, are increasingly used for rainfall measurement. The lack of conventions defining which data should be stored and how, makes it difficult to automatically process the data and integrate these observations into standard monitoring networks. This paper reviews current practice of collecting and storing precipitation opportunistic sensing (OS) data based on the experience of more than 100 members of the OpenSense Cost Action and suggest common data format standards. We focus on three sensors identified by the OpenSense community as prominent representatives of the OS of precipitation: Commercial microwave links (CML), Satellite Microwave Links (SML), and Personal Weather Stations (PWS). The conventions are already now accepted by the ever growing OpenSense community and represent an important step towards automated processing of OS raw data and community development of joint OS software packages.

Commercial microwave links for urban drainage modelling: The effect of link characteristics and their position on runoff simulations.

Commercial microwave links (CMLs), radio connections widely used in telecommunication networks, can provide path-integrated quantitative precipitation estimates (QPEs) which could complement traditional precipitation observations. This paper assesses the ability of individual CMLs to provide relevant QPEs for urban rainfall-runoff simulations and specifically investigates the influence of CML characteristics and position on the predicted runoff. The analysis is based on a 3-year-long experimental data set from a small (1.3 km2) urban catchment located in Prague, Czech Republic. QPEs from real world CMLs are used as inputs for urban rainfall-runoff predictions and subsequent modelling performance is assessed by comparing simulated runoffs with measured stormwater discharges. The results show that model performance is related to both the sensitivity of CML to rainfall and CML position. The bias propagated into the runoff predictions is inversely proportional to CML path length. The effect of CML position is especially pronounced during heavy rainfalls, when QPEs from shorter CMLs, located within or close to catchment boundaries, better reproduce runoff dynamics than QPEs from longer CMLs extending far beyond the catchment boundaries. Interestingly, QPEs averaged from all available CMLs best reproduce the runoff temporal dynamics. Adjusting CML QPEs to three rain gauges located 2-3 km outside of the catchment substantially reduces the bias in CML QPEs. Unfortunately, this compromises the ability of the CML QPEs to reproduce runoff dynamics during heavy rainfalls. More experimental case studies are necessary to provide specific recommendations on CML preprocessing methods tailored to different water management tasks, catchments and CML networks.

Robust model for estimating pumping station characteristics and sewer flows from standard pumping station data.

Flow data represent crucial input for reliable diagnostics of sewer functions and identification of potential problems such as unwanted inflow and infiltration. Flow estimates from pumping stations, which are an integral part of most separate sewer systems, might help in this regard. A robust model and an associated optimization procedure is proposed for estimating inflow to a pumping station using only registered water levels in the pump sump and power consumption. The model was successfully tested on one month of data from a single upstream station. The model is suitable for identification of pump capacity and volume thresholds for switching the pump on and off. These are parameters which are required for flow estimation during periods with high inflows or during periods with flow conditions triggering pump switching on and off at frequencies close to the temporal resolution of monitored data. The model is, however, sensitive within the transition states between emptying and filling to observation errors in volume and on inflow/outflow variability.

Use of autonomous transmission line-type electromagnetic sensors for classification of dry and wet periods at sub-hourly time intervals.

Accurate identification of wet and dry weather periods at sub-hourly time intervals is important for the description and control of processes directly influenced by rainfall, such as infiltration into urban drainage systems, purification processes in wastewater treatment plants, or effective irrigation systems. It is also necessary for monitoring and modeling rainfall itself. Traditional instrumentation used to measure rainfall (rain gauges and radars) often fails to detect the transition between dry and wet weather at sufficient spatial and temporal resolution. Opportunistic sensing has become a promising approach in hydrology to overcome these deficits without drastically increasing the cost of measuring campaigns. In this study, we identify dry and wet weather periods using autonomous and inexpensive transmission line-type electromagnetic sensors, primarily intended for soil water content measurement.Four transmission line-type electromagnetic sensors, a tipping bucket rain gauge, and a laser precipitation monitor were installed in an urban catchment for an experimental period of 3 months during the summer. An algorithm for the reliable detection of the onset and end of precipitation episodes was developed for use with the sensors. Our analysis demonstrates that transmission line-type electromagnetic sensors provide results with accuracy similar to, and with five times greater sensitivity than a tipping bucket rain gauge. However, the sensors produced false-negative results more than 1.6% of the time (i.e., 25% of the received rain). Nevertheless, the low specificity of the sensors is not critical when they are used in combination with rain gauges or other sensors that are less prone to falsely detect wet periods.

Runoff prediction using rainfall data from microwave links: Tabor case study.

Rainfall spatio-temporal distribution is of great concern for rainfall-runoff modellers. Standard rainfall observations are, however, often scarce and/or expensive to obtain. Thus, rainfall observations from non-traditional sensors such as commercial microwave links (CMLs) represent a promising alternative. In this paper, rainfall observations from a municipal rain gauge (RG) monitoring network were complemented by CMLs and used as an input to a standard urban drainage model operated by the water utility of the Tabor agglomeration (CZ). Two rainfall datasets were used for runoff predictions: (i) the municipal RG network, i.e. the observation layout used by the water utility, and (ii) CMLs adjusted by the municipal RGs. The performance was evaluated in terms of runoff volumes and hydrograph shapes. The use of CMLs did not lead to distinctively better predictions in terms of runoff volumes; however, CMLs outperformed RGs used alone when reproducing a hydrograph's dynamics (peak discharges, Nash-Sutcliffe coefficient and hydrograph's rising limb timing). This finding is promising for number of urban drainage tasks working with dynamics of the flow. Moreover, CML data can be obtained from a telecommunication operator's data cloud at virtually no cost. That makes their use attractive for cities unable to improve their monitoring infrastructure for economic or organizational reasons.

Commercial microwave links instead of rain gauges: fiction or reality?

Commercial microwave links (MWLs) were suggested about a decade ago as a new source for quantitative precipitation estimates (QPEs). Meanwhile, the theory is well understood and rainfall monitoring with MWLs is on its way to being a mature technology, with several well-documented case studies, which investigate QPEs from multiple MWLs on the mesoscale. However, the potential of MWLs to observe microscale rainfall variability, which is important for urban hydrology, has not been investigated yet. In this paper, we assess the potential of MWLs to capture the spatio-temporal rainfall dynamics over small catchments of a few square kilometres. Specifically, we investigate the influence of different MWL topologies on areal rainfall estimation, which is important for experimental design or to a priori check the feasibility of using MWLs. In a dedicated case study in Prague, Czech Republic, we collected a unique dataset of 14 MWL signals with a temporal resolution of a few seconds and compared the QPEs from the MWLs to reference rainfall from multiple rain gauges. Our results show that, although QPEs from most MWLs are probably positively biased, they capture spatio-temporal rainfall variability on the microscale very well. Thus, they have great potential to improve runoff predictions. This is especially beneficial for heavy rainfall, which is usually decisive for urban drainage design.