Rating the Valence of Media Content about Electronic Cigarettes Using Crowdsourcing: Testing Rater Instructions and Estimating the Optimal Number of Raters.

Electronic cigarettes (e-cigarettes) are a controversial public health topic due to their increasing popularity among youth and the uncertainty about their risks and benefits. Researchers have started to assess the valence of media content about e-cigarette use, mostly using expert coding. The current study aims to offer a methodological framework and guideline when using crowdsourcing to rate the valence of e-cigarette media content. Specifically, we present (1) an experiment to determine rating instructions that would result in reliable valence ratings and (2) an analysis to identify the optimal number of raters needed to replicate these ratings. Specifically, we compared ratings produced by crowdsourced raters instructed to rate from several different perspectives (e.g., objective vs. subjective) and determined the instructions that led to reliable ratings. We then used bootstrapping methods and a set of criteria to identify the minimum number of raters needed to replicate these ratings. Results suggested that when rating e-cigarette valence, instructing raters to rate from their own subjective perspective produced reliable results, and nine raters were deemed the optimal number of raters. We expect these findings to inform future content analyses of e-cigarette valence. The study procedures can be applied to crowdsourced content analyses of other health-related media content to determine appropriate rating instructions and the number of raters.

Valence of Media Coverage About Electronic Cigarettes and Other Tobacco Products From 2014 to 2017: Evidence From Automated Content Analysis.

INTRODUCTION: As media exposure can influence people's opinions and perceptions about vaping and smoking, analyzing the valence of media content about tobacco products (ie, overall attitude toward tobacco, cigars, electronic cigarettes, etc.) is an important issue. This study advances the field by analyzing a large amount of media content about multiple tobacco products across six different media sources. AIMS AND METHODS: From May 2014 to December 2017, we collected all English-language media items about tobacco products that U.S. young people might see from mass media and websites (long-form) and social media (Twitter and YouTube). We used supervised machine learning to develop validated algorithms to label the valence of these media items. Using the labeled results, we examined the impact of product type (e-cigarettes vs. other tobacco products), source (long-form vs. social media), and time (by month) on the valence of coverage. RESULTS: We obtained 152 886 long-form media texts (20% with more than a passing mention), nearly 86 million tweets, and 12 262 YouTube videos about tobacco products. Most long-form media content opposed, while most social media coverage supported, the use of e-cigarettes and other tobacco products. Over time, within-source valence proportions were stable, though in aggregate, the amount of media coverage against the use of tobacco products decreased. CONCLUSIONS: This study describes the U.S. public communication environment about vaping and smoking for young people and offers a novel big data approach to analyzing media content. Results suggest that content has gradually become less negative toward the use of e-cigarettes and other tobacco products. IMPLICATIONS: This study is the first to examine how the valence of media coverage differs for e-cigarettes versus other tobacco products, across several media sources, and over time using a large corpus of media items. Unlike prior studies, these data allow us to draw conclusions about relative support and opposition for these two categories of products in a variety of media coverage because the same coding scheme was used across products and media sources.

Breadth of Media Scanning Leads to Vaping among Youth and Young Adults: Evidence of Direct and Indirect Pathways from a National Longitudinal Survey.

Electronic cigarette use among youth and young adults has reached an epidemic proportion of growth. This study examined the direct and indirect effects of the breadth of media scanning about e-cigarette use on subsequent vaping behavior through interpersonal communication and changes in descriptive norm perceptions. We conducted a nationally representative longitudinal phone survey of 13- to 25-year-olds from June 2014 to March 2017, with 11,013 respondents who completed a baseline survey, among which 3,212 completed a follow-up 6 months later. The results from both cross-sectional and lagged analyses provided robust evidence to suggest that passive routine exposure to e-cigarette use content from more media outlets predicted increased likelihood of vaping among youth and young adults. High scanners were about twice as likely to vape as non-scanners (17% versus 9%). Mediation models using bootstrapping procedures found that breadth of scanning predicted higher descriptive norm perceptions which were associated with subsequent vaping; in addition, interpersonal communication mediated the relationship between breadth of scanning and changes in descriptive norm perceptions. These findings highlight the important roles of scanning, norm perceptions and interpersonal discussions in shaping cognition and behavior changes. The results also suggest an overall pro-e-cigarette public communication environment, which warrants further examination.

Combining Crowd-Sourcing and Automated Content Methods to Improve Estimates of Overall Media Coverage: Theme Mentions in E-cigarette and Other Tobacco Coverage.

Exposure to media content can shape public opinions about tobacco. Accurately describing content is a first step to showing such effects. Historically, content analyses have hand-coded tobacco-focused texts from a few media sources which ignored passing mention coverage and social media sources, and could not reliably capture over-time variation. By using a combination of crowd-sourced and automated coding, we labeled the population of all e-cigarette and other tobacco-related (including cigarettes, hookah, cigars, etc.) 'long-form texts' (focused and passing coverage, in mass media and website articles) and social media items (tweets and YouTube videos) collected May 2014-June 2017 for four tobacco control themes. Automated coding of theme coverage met thresholds for item-level precision and recall, event validation, and weekly-level reliability for most sources, except YouTube. Health, Policy, Addiction and Youth themes were frequent in e-cigarette long-form focused coverage (44%-68%), but not in long-form passing coverage (5%-22%). These themes were less frequent in other tobacco coverage (long-form focused (13-32%) and passing coverage (4-11%)). Themes were infrequent in both e-cigarette (1-3%) and other tobacco tweets (2-4%). Findings demonstrate that passing e-cigarette and other tobacco long-form coverage and social media sources paint different pictures of theme coverage than focused long-form coverage. Automated coding also allowed us to code the amount of data required to estimate reliable weekly theme coverage over three years. E-cigarette theme coverage showed much more week-to-week variation than did other tobacco coverage. Automated coding allows accurate descriptions of theme coverage in passing mentions, social media, and trends in weekly theme coverage.

The Relationship Between Exogenous Exposure to "The Real Cost" Anti-Smoking Campaign and Campaign-Targeted Beliefs.

Though previous evaluations of "The Real Cost" anti-smoking campaign demonstrate effects on anti-smoking beliefs and behaviors, results rely on self-reported recall as a measure of exposure and are thus open to reverse causation concerns. Exogenous measures of exposure, assessed independently of outcomes, support stronger causal inferences. In this study, we examined the relationship between Target Rating Points (TRPs) for specific ads available over four-week periods and anti-smoking beliefs in a national sample of adolescent nonsmokers and experimenters (n = 4,780). Results demonstrate positive relationships between TRPs for ads targeting two of four belief categories tested (Control and Chemical; p < .05) and targeted-belief endorsement. Furthermore, moderation models indicate that ad-specific TRPs affected targeted beliefs more than non-targeted beliefs for those Control- and Chemical-targeted ads (p < .01). Findings support a claim of campaign effects while reducing concerns about reverse causal direction and the influence of unmeasured confounders.

Validating the Hornik & Woolf approach to choosing media campaign themes: Do promising beliefs predict behavior change in a longitudinal study?

Hornik and Woolf (1999) proposed using cross-sectional survey data to prioritize beliefs to address with communication campaign messages. The empirical component of the approach combines evidence of (1) association of beliefs with intentions and (2) current level of beliefs to calculate a 'percentage to gain' as the potential promise of a belief. However, the method relies on cross-sectional data; its conclusions are open to challenge. Here, a panel study assesses whether the calculated promise of a belief actually predicts future behavior change. A nationally representative sample of 3,204 U.S. youth and young adults were interviewed twice, six months apart. Sixteen beliefs about the benefits and costs of smoking cigarettes are compared with regard to their percentage to gain (calculated from cross-sectional data) and their ability to account for subsequent cigarette use. A belief's cross-sectional percentage to gain is substantially associated with its ability to predict subsequent behavior change (r=.53, p<.05).

Identifying Potential Campaign Themes to Prevent Youth Initiation of E-Cigarettes.

Once a target audience and a health behavior of interest are selected for a potential mass media campaign, the next task is selecting beliefs about the health behavior to serve as the basis for campaign message content. For novel health behaviors, such as the use of emerging tobacco products, limited empirical research on beliefs about these behaviors exists. A multimethod approach was applied to generate potential campaign beliefs for emerging behaviors. Three methods were conducted in this investigation in order to generate a list of potential testable campaign beliefs, using youth e-cigarette use as a case study: (1) a search of published and unpublished literature including gathering measures from several national surveys (through 2016), (2) an online elicitation survey (conducted in 2016), and (3) unsupervised topic modeling of media texts (from 2014 to 2015, analyzed in 2016). Details are provided on how each method was employed to both generate and prioritize beliefs related to youth e-cigarette use into a final set of 115 beliefs across 23 belief themes. This multimethod approach can provide four utilities when thinking through a health campaign for novel health behaviors: (1) developing an exhaustive and complementary list of beliefs, (2) generating overarching themes and distilling larger themes into more nuanced beliefs, (3) identifying language most relevant to the target population, and (4) prioritizing beliefs for message pilot testing with members of the target audience. SUPPLEMENT INFORMATION: This article is part of a supplement entitled Fifth Anniversary Retrospective of "The Real Cost," the Food and Drug Administration's Historic Youth Smoking Prevention Media Campaign, which is sponsored by the U.S. Food and Drug Administration.

Message-Elicited Brain Response Moderates the Relationship Between Opportunities for Exposure to Anti-Smoking Messages and Message Recall.

Campaign success is contingent on adequate exposure; however, exposure opportunities (e.g., ad reach/frequency) are imperfect predictors of message recall. We hypothesized that the exposure-recall relationship would be contingent on message processing. We tested moderation hypotheses using 3 data sets pertinent to "The Real Cost" anti-smoking campaign: past 30-day ad recall from a rolling national survey of adolescents aged 13-17 (n = 5,110); ad-specific target rating points (TRPs), measuring ad reach and frequency; and ad-elicited response in brain regions implicated in social processing and memory encoding, from a separate adolescent sample aged 14-17 (n = 40). Average ad-level brain activation in these regions moderates the relationship between national TRPs and large-scale recall (p < .001), such that the positive exposure-recall relationship is more strongly observed for ads that elicit high levels of social processing and memory encoding in the brain. Findings advance communication theory by demonstrating conditional exposure effects, contingent on social and memory processes in the brain.

Toward an Aggregate, Implicit, and Dynamic Model of Norm Formation: Capturing Large-Scale Media Representations of Dynamic Descriptive Norms Through Automated and Crowdsourced Content Analysis.

Media content can shape people's descriptive norm perceptions by presenting either population-level prevalence information or descriptions of individuals' behaviors. Supervised machine learning and crowdsourcing can be combined to answer new, theoretical questions about the ways in which normative perceptions form and evolve through repeated, incidental exposure to normative mentions emanating from the media environment. Applying these methods, this study describes tobacco and e-cigarette norm prevalence and trends over 37 months through an examination of a census of 135,764 long-form media texts, 12,262 popular YouTube videos, and 75,322,911 tweets. Long-form texts mentioned tobacco population norms (4-5%) proportionately less often than e-cigarette population norms (20%). Individual use norms were common across sources, particularly YouTube (tobacco long-form: 34%; Twitter: 33%; YouTube: 88%; e-cigarette long form: 17%; Twitter: 16%; YouTube: 96%). The capacity to capture aggregated prevalence and temporal dynamics of normative media content permits asking population-level media effects questions that would otherwise be infeasible to address.

Promising Themes for Antismoking Campaigns Targeting Youth and Young Adults.

OBJECTIVES: Behavior change campaigns typically try to change beliefs that influence behaviors, with targeted beliefs comprising the campaign theme. We present an empirical approach for choosing among a large number of potential themes, and results from the implementation of this approach for campaigns aimed at 4 behavioral targets: (1) preventing smoking initiation among youth, and (2) preventing initiation, (3) stopping progression to daily smoking and (4) encouraging cessation among young adults. METHODS: An online survey of 13- to 17-year-olds and 18- to 25-year-olds in the United States (US), in which 20 potential campaign themes were represented by 154 beliefs. For each behavioral target, themes were ranked based on the strength of belief-intention and belief-behavior associations and size of the population not already endorsing the beliefs. RESULTS: The most promising themes varied across behavioral targets but 3 were consistently promising: consequences of smoking for mood, social acceptance and social popularity. CONCLUSIONS: Using a robust and systematic approach, this study provides campaign developers with empirical data to inform their selection of promising themes. Findings related to the campaign to prevent initiation among youth informed the development of the US Food and Drug Administration's "The Real Cost" campaign.

Recall of "The Real Cost" Anti-Smoking Campaign Is Specifically Associated With Endorsement of Campaign-Targeted Beliefs.

Though previous research suggests the FDA's "The Real Cost" anti-smoking campaign has reduced smoking initiation, the theorized pathway of effects (through targeted beliefs) has not been evaluated. This study assesses the relationship between recall of campaign television advertisements and ad-specific anti-smoking beliefs. Respondents in a nationally representative survey of nonsmoking youths age 13-17 (n = 4,831) reported exposure to four The Real Cost advertisements and a fake ad, smoking-relevant beliefs, and nonsmoking intentions. Analyses separately predicted each targeted belief from specific ad recall, adjusting for potential confounders and survey weights. Parallel analyses with non-targeted beliefs showed smaller effects, strengthening claims of campaign effects. Recall of four campaign ads (but not the fake ad) significantly predicted endorsement of the ad-targeted belief (Mean ß = .13). Two-sided sign tests indicated stronger ad recall associations with the targeted belief relative to the non-targeted belief (p < .05). Logistic regression analyses indicated that respondents who endorsed campaign-targeted beliefs were more likely to have no intention to smoke (p < .01). This study is the first to demonstrate a relationship between recall of ads from The Real Cost campaign and the theorized pathway of effects (through targeted beliefs). These analyses also provide a methodological template for showing campaign effects despite limitations of available data.

Association Between Initial Use of e-Cigarettes and Subsequent Cigarette Smoking Among Adolescents and Young Adults: A Systematic Review and Meta-analysis.

Importance: The public health implications of e-cigarettes depend, in part, on whether e-cigarette use affects the risk of cigarette smoking. Objective: To perform a systematic review and meta-analysis of longitudinal studies that assessed initial use of e-cigarettes and subsequent cigarette smoking. Data Sources: PubMed, EMBASE, Cochrane Library, Web of Science, the 2016 Society for Research on Nicotine and Tobacco 22nd Annual Meeting abstracts, the 2016 Society of Behavioral Medicine 37th Annual Meeting & Scientific Sessions abstracts, and the 2016 National Institutes of Health Tobacco Regulatory Science Program Conference were searched between February 7 and February 17, 2017. The search included indexed terms and text words to capture concepts associated with e-cigarettes and traditional cigarettes in articles published from database inception to the date of the search. Study Selection: Longitudinal studies reporting odds ratios for cigarette smoking initiation associated with ever use of e-cigarettes or past 30-day cigarette smoking associated with past 30-day e-cigarette use. Searches yielded 6959 unique studies, of which 9 met inclusion criteria (comprising 17 389 adolescents and young adults). Data Extraction and Synthesis: Study quality and risk of bias were assessed using the Newcastle-Ottawa Scale and the Risk of Bias in Non-randomized Studies of Interventions tool, respectively. Data and estimates were pooled using random-effects meta-analysis. Main Outcomes and Measures: Among baseline never cigarette smokers, cigarette smoking initiation between baseline and follow-up. Among baseline non-past 30-day cigarette smokers who were past 30-day e-cigarette users, past 30-day cigarette smoking at follow-up. Results: Among 17 389 adolescents and young adults, the ages ranged between 14 and 30 years at baseline, and 56.0% were female. The pooled probabilities of cigarette smoking initiation were 30.4% for baseline ever e-cigarette users and 7.9% for baseline never e-cigarette users. The pooled probabilities of past 30-day cigarette smoking at follow-up were 21.5% for baseline past 30-day e-cigarette users and 4.6% for baseline non-past 30-day e-cigarette users. Adjusting for known demographic, psychosocial, and behavioral risk factors for cigarette smoking, the pooled odds ratio for subsequent cigarette smoking initiation was 3.62 (95% CI, 2.42-5.41) for ever vs never e-cigarette users, and the pooled odds ratio for past 30-day cigarette smoking at follow-up was 4.28 (95% CI, 2.52-7.27) for past 30-day e-cigarette vs non-past 30-day e-cigarette users at baseline. A moderate level of heterogeneity was observed among studies (I2 = 60.1%). Conclusions and Relevance: e-Cigarette use was associated with greater risk for subsequent cigarette smoking initiation and past 30-day cigarette smoking. Strong e-cigarette regulation could potentially curb use among youth and possibly limit the future population-level burden of cigarette smoking.

Selective Exposure to Health Information: The Role of Headline Features in the Choice of Health Newsletter Articles.

This study investigated how content and context features of headlines drive selective exposure when choosing between headlines of a monthly e-mail health newsletter in a naturalistic setting over a period of nine months. Study participants received a monthly e-mail newsletter and could freely open it and click any headline to read the accompanying article. In each e-mail newsletter, nine headlines competed with each other for selection. Textual and visual information of the headlines was content-analyzed, and clickstream data on the headlines were collected automatically. The results showed that headlines invited more frequent audience selections when they provided efficacy-signaling information in an imperative voice, when they used a moderate number of negative emotion words, when they presented negative thumbnail images while mentioning cancer or other diseases, and when they were placed higher in position.

Nonmedical information seeking amid conflicting health information: negative and positive effects on prostate cancer screening.

This study investigates the impact of seeking information about the prostate-specific antigen (PSA) test on men's PSA test use during a period of conflicting recommendations. Analyses used longitudinal survey data collected in 2005 and 2006 from a nationally representative sample of U.S. males aged 40-70 years (n = 777). Cross-sectionally, nonmedical information seeking was significantly associated with increased odds of having a PSA test in the past year (Time 1 odds ratio [OR] = 9.74, p < .01, 95% confidence interval [CI] = 4.37, 21.70; Time 2 OR = 5.78, p < .01, 95% CI = 3.17, 10.55). However, lagged analyses showed that among men who had a PSA at Time 1, active seeking is associated with reduced odds of later having a PSA test (OR = 0.33, p < .05, 95% CI = 0.13, 0.85). Participants who had not had a PSA test in the past year very rarely sought information about PSA tests. Information acquisition in an environment of conflicting recommendations may influence adoption of cancer screening behaviors.

Talking About Quitting: Interpersonal Communication as a Mediator of Campaign Effects on Smokers' Quit Behaviors.

This study examined the role of interpersonal communication in the context of a mass media anti-smoking campaign. Specifically, it explored whether conversations about campaign ads and/or about quitting mediated campaign exposure effects on 2 quitting behaviors (sought help to quit and tried to quit smoking completely), as well as the relation between ad-related and quitting-related conversations. Data were collected before the campaign and monthly for 16 months during the campaign through cross-sectional telephone surveys among a sample of 3,277 adult Philadelphia smokers. Follow-up interviews were conducted among 877 participants 3 months after their first survey. Cross-sectional and longitudinal mediation models with bootstrap procedures assessed the indirect effects of campaign exposure on outcomes through conversations, and the indirect effects of conversations about ads on outcomes through conversations about quitting. In addition, lagged regression analyses tested the causal direction of associations between the variables of interest. The results partially support hypotheses that conversations about quitting mediate campaign effects on quitting-related behaviors and, in line with previous research, that conversations about the ads have indirect effects on quitting-related behaviors by triggering conversations about quitting. These findings demonstrate the importance of considering interpersonal communication as a route of campaign exposure effects when evaluating and designing future public health campaigns.

Evolving Information Needs among Colon, Breast, and Prostate Cancer Survivors: Results from a Longitudinal Mixed-Effects Analysis.

BACKGROUND: This study describes how cancer survivors' information needs about recurrence, late effects, and family risks of cancer evolve over the course of their survivorship period. METHODS: Three annual surveys were conducted from 2006 to 2008 in a cohort of Pennsylvania cancer survivors diagnosed with colon, breast, or prostate cancer in 2005 (round 1, N = 2,013; round 2, N = 1,293; round 3, N = 1,128). Outcomes were information seeking about five survivorship topics. Key predictors were survey round, cancer diagnosis, and the interaction between these variables. Mixed-effects logistic regression analyses were performed to predict information seeking about each topic, adjusting for demographic variables, clinical characteristics, and clustering of repeated observations within individuals. RESULTS: Information seeking about reducing risks of cancer recurrence was the most frequently reported topic across survivors and over time. Breast cancer survivors were more likely to seek about survivorship topics at round 1 compared with other survivors. In general, information seeking declined over time, but cancer-specific patterns emerged: the decline was sharpest for breast cancer survivors, whereas in later years female colon cancer survivors actually sought more information (about how to reduce the risk of family members getting colon cancer or a different cancer). CONCLUSION: Cancer survivors' information needs varied over time depending on the topic, and these trends differed by cancer type. IMPACT: Clinicians may need to intervene at distinct points during the survivorship period with information to address concerns about cancer recurrence, late effects, and family members' risks.

Are young people's beliefs about menthol cigarettes associated with smoking-related intentions and behaviors?

INTRODUCTION: Little is known about the beliefs that youth and young adults hold about menthol cigarettes or the influence of these beliefs on tobacco use initiation. METHODS: Online cross-sectional surveys with 13- to 17-year-old current nonsmokers (n = 553) and 18- to 25-year-old never (n = 586) and current tobacco users (n = 307) in the United States assessed the association between endorsing each of 9 pro-menthol beliefs and (a) intentions to smoke menthol cigarettes over the next year, (b) current use of menthol cigarettes, (c) intentions to use tobacco in general over the next year, and (d) current use of tobacco products in general. RESULTS: Menthols were perceived to be less harmful and addictive than nonmenthol cigarettes by between 13% and 23% of respondents. Between 20% and 58% believed that menthols had favorable sensory properties, and 7%-25% believed that menthol smokers were more popular and attractive than nonmenthol smokers. Logistic regression analyses (adjusting for confounders) indicated that, on the whole, those who endorsed pro-menthol beliefs were more likely to intend to use, and to currently use, both menthols and tobacco products in general. For example, respondents who believed that menthol cigarettes were more refreshing in sensation (one of the most frequently endorsed beliefs) were significantly more likely to (a) intend to smoke menthol cigarettes (13- to 17-year-olds, odds ratio [OR] = 2.12, 95% confidence interval [CI] = 1.03, 4.34; 18- to 25-year olds, OR = 2.62, 95% CI = 1.04, 6.60), (b) currently use menthol cigarettes (18- to 25-year olds, OR = 3.40, 95% CI = 2.20, 5.26), (c) intend to use tobacco (13- to 17-year-olds OR = 1.74, 95% CI = 1.14, 2.65), and (d) currently use tobacco (18- to 25-year olds, OR = 2.06, 95% CI = 1.44, 2.93). CONCLUSIONS: Youth and young adults who do not currently smoke and who hold favorable beliefs about menthol cigarettes are at greater risk for beginning to use tobacco products, indicating that the availability of menthol cigarettes may contribute to tobacco use initiation. These findings support recent claims that the elimination of menthol cigarettes would improve public health in the United States.

The role of patient-clinician information engagement and information seeking from nonmedical channels in fruit and vegetable intake among cancer patients.

Previous research suggests positive effects of health information seeking on prevention behaviors such as diet, exercise, and fruit and vegetable consumption. The present study builds upon this research and strengthens causal claims from it by examining the lagged effect of patient-clinician information engagement on fruit and vegetable consumption as well as the indirect effect on the outcome through seeking information from nonmedical channels. The results are based on data collected from a randomly drawn sample of breast, prostate, and colorectal cancer patients from the Pennsylvania Cancer Registry who completed mail surveys in the Fall of 2006 and 2007. There was a 65% response rate for baseline subjects (resulting n = 2,013); of those, 1,293 were interviewed 1 year later, and 1,257 were available for our analyses. Results show a positive lagged main effect of patient-clinician information engagement at baseline on fruit and vegetable consumption at follow-up (B = 0.26, SE = 0.10, p = .01). The mediation analysis shows that patient-clinician information engagement leads to increased fruit and vegetable consumption among cancer patients, in part through patients' information seeking from nonmedical channels. Implications of these findings for the cancer patient population and for physicians are discussed.

Evaluation of a mass media campaign promoting using help to quit smoking.

BACKGROUND: Although there is evidence that promoting individual cessation aids increases their utilization, mass media campaigns highlighting the benefit of using help to quit have not been evaluated. PURPOSE: The effects of a Philadelphia adult smoking-cessation media campaign targeting using help in ad taglines were analyzed from March to November 2012. This study distinctively analyzed the campaign's impact at both the population level (effects on the average person) and the individual level (effects among those who reported exposure). METHODS: The 16-month mass media campaign aired in Philadelphia PA from December 2010 to March 2012. A representative sample of adult Philadelphia smokers was interviewed by telephone at baseline (n=491) and new samples were interviewed monthly throughout the campaign (n=2,786). In addition, a subsample of these respondents was reinterviewed 3 months later (n=877). RESULTS: On average, participants reported seeing campaign ads four times per week. Among individual respondents, each additional campaign exposure per week increased the likelihood of later reporting using help (OR=1.08, p<0.01), adjusting for baseline use of help and other potential confounders. This corresponded to a 5% increase in the use of help for those with average exposure relative to those with no exposure. Cross-sectional associations between individual campaign exposure and intentions to use help were consistent with these lagged findings. However, there was no evidence of population-level campaign effects on use of help. CONCLUSIONS: Although the campaign was effective at the individual level, its effects were too small to have a population-detectable impact.