Developing the Message Assessment Scale for Tobacco Prevention Campaigns: Cross-sectional Validation Study.

BACKGROUND: Mass media campaigns are effective for influencing a broad range of health behaviors. Prior to launching a campaign, developers often conduct ad testing to help identify the strengths and weaknesses of the message executions among the campaign's target audience. This process allows for changes to be made to ads, making them more relevant to or better received by the target audience before they are finalized. To assess the effectiveness of an ad's message and execution, campaign ads are often rated using a single item or multiple items on a scale, and scores are calculated. Endorsement of a 6-item perceived message effectiveness (PME) scale, defined as the practice of using a target audience's evaluative ratings to inform message selection, is one approach commonly used to select messages for antitobacco campaigns; however, the 6-item PME scale often does not produce enough specificity to make important decisions on ad optimization. In addition, the PME scale is typically used with adult populations for smoking cessation messages. OBJECTIVE: This study includes the development of the Message Assessment Scale, a new tobacco prevention message testing scale for youth and young adults. METHODS: Data were derived from numerous cross-sectional surveys designed to test the relevance and potential efficacy of antitobacco truth campaign ads. Participants aged 15-24 years (N=6108) responded to a set of 12 core attitudinal items, including relevance (both personal and cultural) as well as comprehension of the ad's main message. RESULTS: Analyses were completed in two phases. In phase I, mean scores were calculated for each of the 12 attitudinal items by ad type, with higher scores indicating more endorsement of the item. Next, all items were submitted to exploratory factor analysis. A four-factor model fit was revealed and verified with confirmatory factor analysis, resulting in the following constructs: personally relevant, culturally relevant, the strength of messaging, and negative attributes. In phase II, ads were categorized by performance (high/medium/low), and constructs identified in phase I were correlated with key campaign outcomes (ie, main fact agreement and likelihood to vape). Phase II confirmed that the four constructs identified in phase I were all significantly correlated with main fact agreement and vape intentions. CONCLUSIONS: Findings from this study advance the field by establishing an expanded set of validated items to comprehensively assess the potential effectiveness of advertising executions. This set of items expands the portfolio of ad testing measures for ads focused on tobacco use prevention. Findings can inform how best to optimize ad executions and message delivery for health behavior campaigns, particularly those focused on tobacco use prevention among youth and young adult populations.

Early Evidence of an Opioid Education Campaign: A Case Study of Rhode Island.

CONTEXT: The opioid crisis poses a significant burden at a national level, and certain states have seen particularly high rates of misuse, addiction, and overdose. In 2017, Rhode Island reported opioid-related deaths nearly twice the national average. OBJECTIVE: To test message efficacy and evaluate the effectiveness of campaign messaging to shift attitudes/beliefs related to opioid misuse in Rhode Island. DESIGN: In phase 1, near-final versions of 6 advertisements were shown to a sample of the target audience via an online survey portal to assess responses to the messages (N = 1210). Phase 2 of the study employed a pre/posttest design whereby 2 cross-sectional surveys were conducted, first prior to the campaign launch (N = 456) and another survey 6 months later in Rhode Island (N = 433). SETTING: Phase 1 was conducted online using a nationally representative panel, and phase 2 included a convenience sample of participants in Rhode Island recruited to undergo an online survey. PARTICIPANTS: Eighteen- to 29-year-old members of a nationally representative online panel (phase 1) and 15- to 34-year-olds living in the state of Rhode Island during data collection periods. MAIN OUTCOME MEASURE(S): Empathy and destigmatization ("someone like me could become addicted..." and "those who are dependent on prescription opioids are victims") and perceived risk of developing dependence on opioids. RESULTS: In both phases, there was an increase in empathy ("someone") (phase 1: pretest [31%], posttest [42%; z = 5.5, P < .0001] and phase 2 [34% baseline vs 41% follow-up; z = 2.0, P = .04]) and destigmatization ("victims") (phase 1: pretest [54%], posttest [58%; z = 2.2, P = .01] and phase 2 [46% baseline vs 54% follow-up; z = 2.2, P = .03]). There was also an increase in perceived risk: phase 1 (pretest [65%], posttest [75%; z = 5.4, P < .0001]) and phase 2 (66% baseline vs 74% follow-up; z = 2.5, P = .01). CONCLUSIONS: This study demonstrated the potential efficacy of a media campaign to shift young adults' opioid-related attitudes.

The Role of Emotions and Perceived Ad Effectiveness: Evidence From the Truth FinishIt Campaign.

PURPOSE: Examine association between emotional valence and intensity prompted by anti-tobacco advertising messages and perceived ad effectiveness among youth/young adults. DESIGN: Online forced-exposure survey data from a nationally weighted, cross-sectional sample of youth/young adults, collected periodically over a 4-year period. SETTING: National. PARTICIPANTS: Thirty-seven cross-sectional surveys conducted online from June 2015 to January 2018; total N = 9534. All participants, aged 15 to 21, were in the intervention; no control group. INTERVENTION: Individuals participating in premarket testing of truth ads were forced exposed to one of 37 anti-tobacco ads. MEASURES: Emotional response, emotional intensity, and perceived ad effectiveness. Emotional response has been previously studied and measured. Including the discrete measure of "concerned" in positive emotions is unique to our study. It patterned with the other positive emotions when each ad was examined by each emotion. Intensity as measured in this study through the 5-point scale ("how much does this ad make you feel") is unique in the anti-tobacco ad literature. Although several past studies ranked the degree of emotion elicited by ads, they have not incorporated the intensity of emotion as reported by the participant themselves. The scale was used to determine whether perceived ad effectiveness is similar to those used in previous studies. ANALYSIS: Linear regressions were estimated to assess type of emotional sentiment and level of intensity in relation to perceived effectiveness of the message. RESULTS: All 9534 participants were exposed; no control group. The ßs indicate how strongly the emotion variable influences the study outcome of perceived ad effectiveness. Positive emotions (ß = .76) were more highly associated with perceived ad effectiveness (ß = .06). Higher intensity with positive emotional sentiment and high-intensity negative produced the highest scores for perceived ad effectiveness (ß = .30). CONCLUSION: Eliciting a positive, high-impact emotional response from viewers can help improve perceived effectiveness, and in turn, overall ad effectiveness.