Assessing the feasibility and sample quality of a national random-digit dialing cellular phone survey of young adults.

The majority of adults aged 18-34 years have only cellular phones, making random-digit dialing of landline telephones an obsolete methodology for surveillance of this population. However, 95% of this group has cellular phones. This article reports on the 2011 National Young Adult Health Survey (NYAHS), a pilot study conducted in the 50 US states and Washington, DC, that used random-digit dialing of cellular phones and benchmarked this methodology against that of the 2011 Behavioral Risk Factor Surveillance System (BRFSS). Comparisons of the demographic distributions of subjects in the NYAHS and BRFSS (aged 18-34 years) with US Census data revealed adequate reach for all demographic subgroups. After adjustment for design factors, the mean absolute deviations across demographic groups were 3 percentage points for the NYAHS and 2.8 percentage points for the BRFSS, nationally, and were comparable for each census region. Two-sided z tests comparing cigarette smoking prevalence revealed no significant differences between NYAHS and BRFSS participants overall or by subgroups. The design effects of the sampling weight were 2.09 for the NYAHS and 3.26 for the BRFSS. Response rates for the NYAHS and BRFSS cellular phone sampling frames were comparable. Our assessment of the NYAHS methodology found that random-digit dialing of cellular phones is a feasible methodology for surveillance of young adults.

Estimates of cigarette smoking from the NJ adult tobacco survey: real or spurious?

OBJECTIVE: To explore, post hoc, whether a large decline in smoking estimates between the 2005 and 2006 New Jersey Adult Tobacco Surveys is real or spurious given various methodological and environmental changes between the 2 time periods of data collection. METHODS: Using multiple data sources, we explored survey timing, poststratification approach, midinterview terminations, wireless substitution, and question order. RESULTS: Changes in question order were likely responsible for the majority of the unexpected decline in smoking prevalence; to a lesser degree, wireless substitution and midinterview terminations also likely contributed to an artificially exaggerated decline. CONCLUSION: Methodological changes can artificially affect trends in prevalence estimates.