Measuring User Compliance and Cost Effectiveness of Safe Drinking Water Programs: A Cluster-Randomized Study of Household Ultraviolet Disinfection in Rural Mexico.

Low adoption and compliance levels for household water treatment and safe storage (HWTS) technologies have made it challenging for these systems to achieve measurable health benefits in the developing world. User compliance remains an inconsistently defined and poorly understood feature of HWTS programs. In this article, we develop a comprehensive approach to understanding HWTS compliance. First, our Safe Drinking Water Compliance Framework disaggregates and measures the components of compliance from initial adoption of the HWTS to exclusive consumption of treated water. We apply this framework to an ultraviolet (UV)-based safe water system in a cluster-randomized controlled trial in rural Mexico. Second, we evaluate a no-frills (or "Basic") variant of the program as well as an improved (or "Enhanced") variant, to test if subtle changes in the user interface of HWTS programs could improve compliance. Finally, we perform a full-cost analysis of both variants to assess their cost effectiveness (CE) in achieving compliance. We define "compliance" strictly as the habit of consuming safe water. We find that compliance was significantly higher in the groups where the UV program variants were rolled out than in the control groups. The Enhanced variant performed better immediately postintervention than the Basic, but compliance (and thus CE) degraded with time such that no effective difference remained between the two versions of the program.

Field efficacy evaluation and post-treatment contamination risk assessment of an ultraviolet disinfection and safe storage system.

Inconsistent use of household water treatment and safe storage (HWTS) systems reduces their potential health benefits. Ultraviolet (UV) disinfection is more convenient than some existing HWTS systems, but it does not provide post-treatment residual disinfectant, which could leave drinking water vulnerable to recontamination. In this paper, using as-treated analyses, we report on the field efficacy of a UV disinfection system at improving household drinking water quality in rural Mexico. We further assess the risk of post-treatment contamination from the UV system, and develop a process-based model to better understand household risk factors for recontamination. This study was part of a larger cluster-randomized stepped wedge trial, and the results complement previously published population-level results of the intervention on diarrheal prevalence and water quality. Based on the presence of Escherichia coli (proportion of households with ≥ 1 E. coli/100 mL), we estimated a risk difference of -28.0% (95% confidence interval (CI): -33.9%, -22.1%) when comparing intervention to control households; -38.6% (CI: -48.9%, -28.2%) when comparing post- and pre-intervention results; and -37.1% (CI: -45.2%, -28.9%) when comparing UV disinfected water to alternatives within the household. We found substantial increases in post-treatment E. coli contamination when comparing samples from the UV system effluent (5.0%) to samples taken from the storage container (21.1%) and drinking glasses (26.0%). We found that improved household infrastructure, additional extractions from the storage container, additional time from when the storage container was filled, and increased experience of the UV system operator were associated with reductions in post-treatment contamination. Our results suggest that the UV system is efficacious at improving household water quality when used as intended. Promoting safe storage habits is essential for an effective UV system dissemination. The drinking glass appears to represent a small but significant source of recontamination that is likely to impact all HWTS systems.

Coliform bacteria as indicators of diarrheal risk in household drinking water: systematic review and meta-analysis.

BACKGROUND: Current guidelines recommend the use of Escherichia coli (EC) or thermotolerant ("fecal") coliforms (FC) as indicators of fecal contamination in drinking water. Despite their broad use as measures of water quality, there remains limited evidence for an association between EC or FC and diarrheal illness: a previous review found no evidence for a link between diarrhea and these indicators in household drinking water. OBJECTIVES: We conducted a systematic review and meta-analysis to update the results of the previous review with newly available evidence, to explore differences between EC and FC indicators, and to assess the quality of available evidence. METHODS: We searched major databases using broad terms for household water quality and diarrhea. We extracted study characteristics and relative risks (RR) from relevant studies. We pooled RRs using random effects models with inverse variance weighting, and used standard methods to evaluate heterogeneity and publication bias. RESULTS: We identified 20 relevant studies; 14 studies provided extractable results for meta-analysis. When combining all studies, we found no association between EC or FC and diarrhea (RR 1.26 [95% CI: 0.98, 1.63]). When analyzing EC and FC separately, we found evidence for an association between diarrhea and EC (RR: 1.54 [95% CI: 1.37, 1.74]) but not FC (RR: 1.07 [95% CI: 0.79, 1.45]). Across all studies, we identified several elements of study design and reporting (e.g., timing of outcome and exposure measurement, accounting for correlated outcomes) that could be improved upon in future studies that evaluate the association between drinking water contamination and health. CONCLUSIONS: Our findings, based on a review of the published literature, suggest that these two coliform groups have different associations with diarrhea in household drinking water. Our results support the use of EC as a fecal indicator in household drinking water.

Estimation of treatment efficacy with complier average causal effects (CACE) in a randomized stepped wedge trial.

Complier average causal effects (CACE) estimate the impact of an intervention among treatment compliers in randomized trials. Methods used to estimate CACE have been outlined for parallel-arm trials (e.g., using an instrumental variables (IV) estimator) but not for other randomized study designs. Here, we propose a method for estimating CACE in randomized stepped wedge trials, where experimental units cross over from control conditions to intervention conditions in a randomized sequence. We illustrate the approach with a cluster-randomized drinking water trial conducted in rural Mexico from 2009 to 2011. Additionally, we evaluated the plausibility of assumptions required to estimate CACE using the IV approach, which are testable in stepped wedge trials but not in parallel-arm trials. We observed small increases in the magnitude of CACE risk differences compared with intention-to-treat estimates for drinking water contamination (risk difference (RD) = -22% (95% confidence interval (CI): -33, -11) vs. RD = -19% (95% CI: -26, -12)) and diarrhea (RD = -0.8% (95% CI: -2.1, 0.4) vs. RD = -0.1% (95% CI: -1.1, 0.9)). Assumptions required for IV analysis were probably violated. Stepped wedge trials allow investigators to estimate CACE with an approach that avoids the stronger assumptions required for CACE estimation in parallel-arm trials. Inclusion of CACE estimates in stepped wedge trials with imperfect compliance could enhance reporting and interpretation of the results of such trials.

Effect of submarine groundwater discharge on bacterial indicators and swimmer health at Avalon Beach, CA, USA.

Use of fecal indicator bacteria (FIB) for monitoring beach water quality is based on their co-occurrence with human pathogens, a relationship that can be dramatically altered by fate and transport processes after leaving the human intestine. We conducted a prospective cohort study at Avalon Beach, California (USA), where the indicator relationship is potentially affected by the discharge of sewage-contaminated groundwater and by solar radiation levels at this shallow, relatively quiescent beach. The goals of this study were to determine: 1) if swimmers exposed to marine water were at higher risk of illness than non-swimmers; 2) if FIB measured in marine water were associated with swimmer illness, and; 3) if the associations between FIB and swimmer health were modified by either submarine groundwater discharge or solar radiation levels. There were 7317 individuals recruited during the summers of 2007-08, 6165 (84%) of whom completed follow-up within two weeks of the beach visit. A total of 703 water quality samples were collected across multiple sites and time periods during recruitment days and analyzed for FIB using both culture-based and molecular methods. Adjusted odds ratios (AOR) indicated that swimmers who swallowed water were more likely to experience Gastrointestinal Illness (GI Illness) within three days of their beach visit than non-swimmers, and that this risk was significantly elevated when either submarine groundwater discharge was high (AOR [95% CI]:2.18 [1.22-3.89]) or solar radiation was low (2.45 [1.25-4.79]). The risk of GI Illness was not significantly elevated for swimmers who swallowed water when groundwater discharge was low or solar radiation was high. Associations between GI Illness incidence and FIB levels (Enterococcus EPA Method 1600) among swimmers who swallowed water were not significant when we did not account for groundwater discharge, but were strongly associated when groundwater discharge was high (1.85 [1.06, 3.23]) compared to when it was low (0.77 [0.42, 1.42]; test of interaction: P = 0.03). These results demonstrate the need to account for local environmental conditions when monitoring for, and making decisions about, public health at recreational beaches. The views expressed in this article are those of the authors and do not necessarily reflect the views or policies of the U.S. Environmental Protection Agency.

Water distribution system deficiencies and gastrointestinal illness: a systematic review and meta-analysis.

BACKGROUND: Water distribution systems are vulnerable to performance deficiencies that can cause (re)contamination of treated water and plausibly lead to increased risk of gastrointestinal illness (GII) in consumers. OBJECTIVES: It is well established that large system disruptions in piped water networks can cause GII outbreaks. We hypothesized that routine network problems can also contribute to background levels of waterborne illness and conducted a systematic review and meta-analysis to assess the impact of distribution system deficiencies on endemic GII. METHODS: We reviewed published studies that compared direct tap water consumption to consumption of tap water re-treated at the point of use (POU) and studies of specific system deficiencies such as breach of physical or hydraulic pipe integrity and lack of disinfectant residual. RESULTS: In settings with network malfunction, consumers of tap water versus POU-treated water had increased GII [incidence density ratio (IDR) = 1.34; 95% CI: 1.00, 1.79]. The subset of nonblinded studies showed a significant association between GII and tap water versus POU-treated water consumption (IDR = 1.52; 95% CI: 1.05, 2.20), but there was no association based on studies that blinded participants to their POU water treatment status (IDR = 0.98; 95% CI: 0.90, 1.08). Among studies focusing on specific network deficiencies, GII was associated with temporary water outages (relative risk = 3.26; 95% CI: 1.48, 7.19) as well as chronic outages in intermittently operated distribution systems (odds ratio = 1.61; 95% CI: 1.26, 2.07). CONCLUSIONS: Tap water consumption is associated with GII in malfunctioning distribution networks. System deficiencies such as water outages also are associated with increased GII, suggesting a potential health risk for consumers served by piped water networks.

Swimmer illness associated with marine water exposure and water quality indicators: impact of widely used assumptions.

BACKGROUND: Studies of health risks associated with recreational water exposure require investigators to make choices about water quality indicator averaging techniques, exposure definitions, follow-up periods, and model specifications; however, investigators seldom describe the impact of these choices on reported results. Our objectives are to report illness risk from swimming at a marine beach affected by nonpoint sources of urban runoff, measure associations between fecal indicator bacteria levels and subsequent illness among swimmers, and investigate the sensitivity of results to a range of exposure and outcome definitions. METHODS: In 2009, we enrolled 5674 people in a prospective cohort at Malibu Beach, a coastal marine beach in California, and measured daily health symptoms 10-19 days later. Concurrent water quality samples were analyzed for indicator bacteria using culture and molecular methods. We compared illness risk between nonswimmers and swimmers, and among swimmers exposed to various levels of fecal indicator bacteria. RESULTS: Diarrhea was more common among swimmers than nonswimmers (adjusted odds ratio = 1.88 [95% confidence interval = 1.09-3.24]) within 3 days of the beach visit. Water quality was generally good (fecal indicator bacteria levels exceeded water quality guidelines for only 7% of study samples). Fecal indicator bacteria levels were not consistently associated with swimmer illness. Sensitivity analyses demonstrated that overall inference was not substantially affected by the choice of exposure and outcome definitions. CONCLUSIONS: This study suggests that the 3 days following a beach visit may be the most relevant period for health outcome measurement in recreational water studies. Under the water quality conditions observed in this study, fecal indicator bacteria levels were not associated with swimmer illness.

A stepped wedge, cluster-randomized trial of a household UV-disinfection and safe storage drinking water intervention in rural Baja California Sur, Mexico.

In collaboration with a local non-profit organization, this study evaluated the expansion of a program that promoted and installed Mesita Azul, an ultraviolet-disinfection system designed to treat household drinking water in rural Mexico. We conducted a 15-month, cluster-randomized stepped wedge trial by randomizing the order in which 24 communities (444 households) received the intervention. We measured primary outcomes (water contamination and diarrhea) during seven household visits. The intervention increased the percentage of households with access to treated and safely stored drinking water (23-62%), and reduced the percentage of households with Escherichia coli contaminated drinking water (risk difference (RD): -19% [95% CI: -27%, -14%]). No significant reduction in diarrhea was observed (RD: -0.1% [95% CI: -1.1%, 0.9%]). We conclude that household water quality improvements measured in this study justify future promotion of the Mesita Azul, and that future studies to measure its health impact would be valuable if conducted in populations with higher diarrhea prevalence.

Using rapid indicators for Enterococcus to assess the risk of illness after exposure to urban runoff contaminated marine water.

BACKGROUND: Traditional fecal indicator bacteria (FIB) measurement is too slow (>18 h) for timely swimmer warnings. OBJECTIVES: Assess relationship of rapid indicator methods (qPCR) to illness at a marine beach impacted by urban runoff. METHODS: We measured baseline and two-week health in 9525 individuals visiting Doheny Beach 2007-08. Illness rates were compared (swimmers vs. non-swimmers). FIB measured by traditional (Enterococcus spp. by EPA Method 1600 or Enterolert™, fecal coliforms, total coliforms) and three rapid qPCR assays for Enterococcus spp. (Taqman, Scorpion-1, Scorpion-2) were compared to health. Primary bacterial source was a creek flowing untreated into ocean; the creek did not reach the ocean when a sand berm formed. This provided a natural experiment for examining FIB-health relationships under varying conditions. RESULTS: We observed significant increases in diarrhea (OR 1.90, 95% CI 1.29-2.80 for swallowing water) and other outcomes in swimmers compared to non-swimmers. Exposure (body immersion, head immersion, swallowed water) was associated with increasing risk of gastrointestinal illness (GI). Daily GI incidence patterns were different: swimmers (2-day peak) and non-swimmers (no peak). With berm-open, we observed associations between GI and traditional and rapid methods for Enterococcus; fewer associations occurred when berm status was not considered. CONCLUSIONS: We found increased risk of GI at this urban runoff beach. When FIB source flowed freely (berm-open), several traditional and rapid indicators were related to illness. When FIB source was weak (berm-closed) fewer illness associations were seen. These different relationships under different conditions at a single beach demonstrate the difficulties using these indicators to predict health risk.