Engagement with Adolescent Substance Prevention Messages: Impact and Dissemination of REAL Media.

This article reviews the development and testing of a youth substance prevention program, REAL media. The contributions of this body of research include theoretical development, measurement, and dissemination of an efficacious independently evaluated program. Special attention is given to the impact of the program through collaborations with multiple community groups and multiple phases of development and testing.

Does Narrative Quality Matter During Implementation of a School-Based Prevention Intervention? A Test of Narrative Engagement Theory.

Narratives play a powerful role in sharing meaning and making sense of experiences. Specifically, health narratives convey storylines, characters, and messages about health-related behaviors and provide audiences with models for healthy behaviors, prompting audiences' health-related reflections and decision-making. Narrative engagement theory (NET) explains how personal narratives can be integrated into interventions to promote health. This study utilizes NET to test direct and indirect effects of teachers' narrative quality on adolescent outcomes during a school-based substance use prevention intervention that includes narrative pedagogy and an implementation strategy. Observational coding of teacher narratives in video-recorded lessons along with self-report student surveys (N = 1,683) were subjected to path analysis. Findings showed significant direct effects of narrative quality on student engagement, norms (i.e. personal, best-friend injunctive, and descriptive norms), and substance use behavior. The analysis also yielded support for indirect effects of narrative quality on adolescent substance use behavior via student engagement, personal norms, and descriptive norms. Findings highlight important issues related to teacher-student interaction during implementation and contributes implications for adolescent substance use prevention research.

Developing the Opioid Rapid Response System™ for Lay Citizen Response to the Opioid Overdose Crisis: a Randomized Controlled Trial.

Emergency responders face challenges in arriving timely to administer naloxone in opioid overdoses. Therefore, interest in having lay citizens administer naloxone nasal spray has emerged. These citizens, however, must be recruited and trained, and be in proximity to the overdose. This study aimed to develop the Opioid Rapid Response System (ORRS)tm to meet this need by developing a system to recruit and train citizen responders and evaluate outcomes in a randomized clinical trial. ORRS recruitment messages and training platform were developed iteratively and then outcomes for each were evaluated in a randomized, unblinded two-arm waitlist-controlled trial. ORRS was field tested in 5 Indiana counties, recruiting adult citizen responders (age 18 or older) who did not self-identity as a certified first responder. Participants were recruited using either personal or communal messages and then randomly assigned to online naloxone training and waitlisted-control conditions. Pre- and post-surveys were administered online to measure the exposure to recruitment messages and training effects on knowledge of opioid overdose, confidence responding, concerns about responding, and intent to respond. Of the 220 randomized participants (114 training, 106 waitlisted-control), 140 were analyzed (59 training, 81 waitlisted-control). Recruited participants more frequently identified with communal appeal than with the personal appeal (chi-square = 53.5; p < 0.0001). Between-group differences for intervention effects were significant for knowledge of overdose signs (Cohen's d = 1.17), knowledge of overdose management (d = 1.72), self-efficacy (d = 1.39), and concerns (d = 1.31), but not for intent (d = 0.17), which suffered from a ceiling effect. ORRS provides stronger support for efficacy than that reported for other training interventions and the digital modality eases rapid dissemination.Trial Registration: NCT04589676.

The Role of Engagement in Effective, Digital Prevention Interventions: the Function of Engagement in the REAL Media Substance Use Prevention Curriculum.

Prevention curricula rely on audience engagement to effectively communicate their messages. However, to date, measurement of engagement has primarily focused on self-report that is often an indicator of liking or satisfaction. Emerging technologies for intervention delivery hold promise not only for additional engagement indicators but also for dissemination outside of traditional vehicles such as classroom delivery. The present study, grounded in the theory of active involvement (Greene 2013), explores the role of engagement (as measured by self-report, program analytics, and observation) with short-term substance use prevention outcomes such as self-efficacy to counter-argue and descriptive and injunctive norms. The study tracks 4-H youth (N = 310) engaged with a media literacy focused e-learning substance prevention curriculum, REAL media. Results indicate that self-reports of engagement predicted self-efficacy to counter-argue, but a program-analytic indicator of dosage predicted lower injunctive and descriptive norms, all at 3 months. The observational indicator was correlated with self-efficacy to counter-argue but not significant in the predictive models. The implications and directions for future research regarding how engagement is measured in prevention and included in studying program effects are discussed. Clinical trial: NCT03157700, May 2017.

Exploring Indicators of Engagement in Online Learning as Applied to Adolescent Health Prevention: A Pilot Study of REAL media.

Engagement is central to the effectiveness of online health messages and the related educational programs that aim to deliver these messages to the intended audience (Li, Won, Yang et al. 2019: Lin, Hung, Kinshuk et al. 2019). Drawing from health communication and social learning theories, the Theory of Active Involvement (TAI) (Greene, 2013) posits that an online prevention program's impact depends on how engaged participants are. In practice, measuring engagement in this context has relied primarily on self-report measures (e.g., Hamutoglu, Gemikonakli, Duman et al. 2019). However, the emergence and growth of online learning platforms to deliver health-specific information offers other options for assessing engagement. This includes program analytics that capture interaction with content and facilitate examination of patterns via multiple indicators such as responses to interactive questions and time spent in the program (Herodotou, Rienties, Boroowa, et al. 2019; Li, Wong, Yang et al. 2019; van Leeuwen, 2019). However, little is known about the relationships between these different indicators of engagement as it applies to health curricula. This study uses self-report, observational, and program analytic data collected on a small (N = 38) sample using REAL media, an online substance use prevention program, to examine relationships among various indicators of engagement. Findings suggest a cluster of indicators across the three modalities that provide a useful way of measuring engagement. A cluster centered around complexity suggests a separate factor to be considered when designing engaging interventions.

"Choose Today, Live Tomorrow": A Content Analysis of Anti-Substance Use Messages Produced by Adolescents.

Adolescent-produced anti-substance use messaging is an increasingly popular and effective prevention strategy. However, little is known about the content of these messages and the production elements adolescents use to bring that content to life. In this article, we present a content analysis of 95 anti-substance use messages developed by 4-H club members across nine U.S. states as part of their participation in the media literacy program REAL media. Posters and videos were content-analyzed for target substance, prevention goal, message form, message content, persuasion strategies, and production elements. Results of the content analysis revealed that combustible tobacco (smoking) was the most popular target substance in the sample among the choices of alcohol, marijuana, e-cigarettes, and chewing tobacco. More youth developed messages with the goal of preventing substance use, rather than stopping current use. Slogans were used in the majority of messages, and nearly all messages took an informational form, rather than narrative or statistical form. Persuasion strategies covered in the curriculum, including fun with the group, unexpected, style, and endorsement were scantily used. Finally, results showed that production value was high in this sample, reflected by the extensive use of color and variety of fonts and font sizes. Implications for future media literacy interventions and research are discussed.

Differential Effects of Parental "drug talk" Styles and Family Communication Environments on Adolescent Substance Use.

The current study examines the relationships among adolescent reports of parent-adolescent drug talk styles, family communication environments (e.g., expressiveness, structural traditionalism, and conflict avoidance), and adolescent substance use. ANCOVAs revealed that the 9th grade adolescents (N = 718) engaged in four styles of "drug talks" with parents (e.g., situated direct, ongoing direct, situated indirect, and ongoing indirect style) and these styles differed in their effect on adolescent substance use. Multiple regression analyses showed that expressiveness and structural traditionalism were negatively related to adolescent substance use, whereas conflict avoidance was positively associated with substance use. When controlling for family communication environments and gender, adolescents with an ongoing indirect style reported the lowest use of substance. The findings suggest implications and future directions for theory and practice.

Trends of Parent-Adolescent Drug Talk Styles in Early Adolescence.

The present study seeks to understand how parents as prevention agents approach substance use prevention messages during the period of early adolescence. Students (N = 410) in a drug prevention trial completed surveys from 7th to 9th grade. Using longitudinal data, a series of latent transition analyses was conducted to identify major trends of parent-adolescent drug talk styles (i.e., never talked, situated direct, ongoing direct, situated indirect, and ongoing indirect) in control and treatment conditions. Findings demonstrate a developmental trend in drug talk styles toward a situated style of talk as youth transitioned from 7th grade to 9th grade. Findings also show that even though the drug prevention trial did not specifically target parental communication, parents in the treatment condition provide more ongoing substance use prevention messages to their adolescent children than do parents in the control condition. The present study discusses relevant developmental issues, potential intervention effects, and future research directions for communication research in substance use prevention.

Entertainment-Education Videos as a Persuasive Tool in the Substance Use Prevention Intervention "keepin' it REAL".

Based on social cognitive theory and narrative engagement theory, the current study examined hypothesized indirect effects of engagement with keepin' it REAL (kiR) curriculum entertainment-education (E-E) videos on youth alcohol use via youth drug offer refusal efficacy. Students in 7th grade (N = 1,464) at 25 public schools in two Midwestern states were randomly assigned to one of the two versions of the kiR curriculum, the kiR urban version and the kiR rural version. Each version had their own set of five culturally-grounded E-E videos depicting communicative skills to refuse drug offers. Differential effects for engagement components were expected depending on the degree of cultural matching. Pre/post surveys were administered at the beginning and the end of 7th grade. Structural equation modeling analysis resulted in partial support for the research hypotheses. Rural youth receiving the urban curriculum who reported higher interest in the E-E videos were more likely to report having higher refusal efficacy, and in turn, less likely to use alcohol. Rural youth receiving the rural curriculum who identified with the E-E video main characters were more likely to report having higher refusal efficacy, and in turn, less likely to use alcohol. Implications for E-E health promotion are discussed.

Parental Messages about Substance Use in Early Adolescence: Extending a Model of Drug-Talk Styles.

This study extends a typology of parent-offspring drug talk styles to early adolescents and investigates associations with adolescent substance use. Data come from a self-report survey associated with a school-based, 7th grade drug prevention curriculum. Mixed methods were used to collect data across four measurement occasions spanning 30 months. Findings highlight the frequencies of various drug-talk styles over time (i.e., situated direct, ongoing direct, situated indirect, ongoing indirect, never talked), messages adolescents hear from parents, and comparisons of alcohol, cigarette, and marijuana use by drug-talk style. This study advances an understanding of parent-adolescent communication about substances and holds practical implications for drug prevention efforts.

Designed Cultural Adaptation and Delivery Quality in Rural Substance Use Prevention: an Effectiveness Trial for the Keepin' it REAL Curriculum.

This study examined how cultural adaptation and delivery quality of the school-based intervention keepin' it REAL (kiR) influenced adolescent substance use. The goal of the study was to compare the effectiveness of the multi-cultural, urban (non-adapted) kiR intervention, a re-grounded (adapted) rural version of the kiR intervention and control condition in a new, rural setting. A total of 39 middle schools in rural communities of two states in the USA were randomly assigned to one of three conditions (i.e., control, non-adapted urban kiR, and adapted rural kiR). Data included adolescent self-reported lifetime substance use and observers' ratings of delivery quality from video recordings of lessons. Ratings of delivery quality were used to create four comparison groups (i.e., low/high delivery quality in non-adapted/urban kiR condition and low/high quality in adapted/rural kiR condition). Controlling for substance use in the 7th grade, findings compared 9th graders' (N = 2781) lifetime alcohol, cigarette, marijuana, and chewing tobacco use. Mixed model analyses revealed that rural youth receiving the culturally adapted/rural curriculum reported significantly less cigarette use than rural youth in the control condition regardless of delivery quality. In the non-adapted/urban condition, youth receiving high delivery quality delivery reported less marijuana use than those receiving low delivery quality condition. However, substance use outcomes of youth receiving high and low delivery quality in the non-adapted intervention did not differ significantly from those the control group. Findings support the effectiveness of the culturally adapted/rural keepin' it REAL curriculum for rural youth.

Improving Prevention Curricula: Lessons Learned Through Formative Research on the Youth Message Development Curriculum.

This article describes formative research (a pilot study, interviews, and focus groups) conducted as part of a feasibility test of 2 versions (Analysis vs. Planning) of a brief media literacy intervention titled Youth Message Development (YMD). The intervention targets high school student alcohol use with activities to understand persuasion strategies, increase counter-arguing, and then apply these new skills to ad analysis or a more engaging ad poster planning activity. Based on the theory of active involvement (Greene, 2013), the Planning curriculum is proposed to be more effective than the Analysis curriculum. Overall, results of the formative research indicated that students (N = 182) and mentors/teachers (N = 53) perceived the YMD Planning curriculum as more interesting, involving, and novel, and these ratings were associated with increased critical thinking about the impact of advertising, lower alcohol use intentions, and fewer positive expectations about the effects of alcohol use. Qualitative feedback indicated a need to supplement alcohol-focused ad stimuli with ads targeting other advertising images, use incentives and competition-based activities to further enhance student motivation, and provide flexibility to enhance the appropriateness of the curriculum to various settings. These concerns led to the development of a revised curriculum and plans for further study.

Exploring Parental Influence on the Progression of Alcohol Use in Mexican-Heritage Youth: a Latent Transition Analysis.

Mexican-heritage youth are members of the fastest growing minority group and are at particular risk for substance use including alcohol consumption. Youth face numerous risk factors including positive descriptions of substance use on media and peer offers that are potentially ameliorated by parental anti-substance use socialization efforts. Guided by primary socialization theory and the theory of planned behavior, the present study posited eight research questions to identify discrete subgroups/patterns of Mexican-heritage youth alcohol use behavior and parental influence on youth outcomes. Longitudinal survey data (n = 1147) from youth in 29 public schools located in Phoenix, Arizona, were collected over 3 years. Latent class and transition analyses identified four discrete subgroups characterized by response patterns of alcohol use behaviors and perceptions in Mexican-heritage youth: (1) non-drinker, (2) potential drinker, (3) experimenter, and (4) regular drinker. Targeted parent-child communication about alcohol and parental monitoring were found to be significant predictors for youth alcohol use. Research implications and future directions are suggested.

Adherence and delivery: implementation quality and program outcomes for the seventh-grade keepin' it REAL program.

Poor implementation quality (IQ) is known to reduce program effects making it important to consider IQ for evaluation and dissemination of prevention programs. However, less is known about the ways specific implementation variables relate to outcomes. In this study, two versions of keepin' it REAL, a seventh-grade drug prevention intervention, were implemented in 78 classrooms in 25 schools in rural districts in Pennsylvania and Ohio. IQ was measured through observational coding of 276 videos. IQ variables included adherence to the curriculum, teacher engagement (attentiveness, enthusiasm, seriousness, clarity, positivity), student engagement (attention, participation), and a global rating of teacher delivery quality. Factor analysis showed that teacher engagement, student engagement, and delivery quality formed one factor, which was labeled delivery. A second factor was adherence to the curriculum. Self-report student surveys measured substance use, norms (beliefs about prevalence and acceptability of use), and efficacy (beliefs about one's ability to refuse substance offers) at two waves (pretest, immediate posttest). Mixed model regression analysis which accounted for missing data and controlled for pretest levels examined implementation quality's effects on individual level outcomes, statistically controlling for cluster level effects. Results show that when implemented well, students show positive outcomes compared to students receiving a poorly implemented program. Delivery significantly influenced substance use and norms, but not efficacy. Adherence marginally significantly predicted use and significantly predicted norms, but not efficacy. Findings underscore the importance of comprehensively measuring and accounting for IQ, particularly delivery, when evaluating prevention interventions.

Resisting pressure from peers to engage in sexual behavior: What communication strategies do early adolescent Latino Girls use?

A content analysis of early adolescent (M=12.02 years) Latino girls' (n=44) responses to open-ended questions imbedded in an electronic survey was conducted to explore strategies girls may use to resist peer pressure with respect to sexual behavior. Analysis yielded 341 codable response units, 74% of which were consistent with the REAL typology (i.e., refuse, explain, avoid, and leave) previously identified in adolescent substance use research. However, strategies reflecting a lack of resistance (11%) and inconsistency with communication competence (e.g., aggression, involving authorities) were also noted (15%). Frequency of particular strategies varied according to offer type, suggesting a variety of strategies may be needed to resist the peer pressure that puts early adolescent girls at risk for engaging in sexual behavior. Findings argue for universality of the REAL typology, building communication competence skills for conflict resolution in dating situations, and including peer resistance strategies in adolescent pregnancy prevention programs.

Teacher Narratives and Student Engagement: Testing Narrative Engagement Theory in Drug Prevention Education.

Testing narrative engagement theory, this study examines student engagement and teachers' spontaneous narratives told in a narrative-based drug prevention curriculum. The study describes the extent to which teachers share their own narratives in a narrative-based curriculum, identifies dominant narrative elements, forms and functions, and assesses the relationships among teacher narratives, overall lesson narrative quality, and student engagement. One hundred videotaped lessons of the keepin' it REAL drug prevention curriculum were coded and the results supported the claim that increased narrative quality of a prevention lesson would be associated with increased student engagement. The quality of narrativity, however, varied widely. Implications of these results for narrative-based prevention interventions and narrative pedagogy are discussed.

Typology of delivery quality: latent profile analysis of teacher engagement and delivery techniques in a school-based prevention intervention, keepin' it REAL curriculum.

Enhancing the delivery quality of school-based, evidence-based prevention programs is one key to ensuring uniform program effects on student outcomes. Program evaluations often focus on content dosage when implementing prevention curricula, however, less is known about implementation quality of prevention content, especially among teachers who may or may not have a prevention background. The goal of the current study is to add to the scholarly literature on implementation quality for a school-based substance use prevention intervention. Twenty-five schools in Ohio and Pennsylvania implemented the original keepin' REAL (kiR) substance use prevention curriculum. Each of the 10, 40-45 min lessons of the kiR curriculum was video recorded. Coders observed and rated a random sample of 276 videos reflecting 78 classes taught by 31 teachers. Codes included teachers' delivery techniques (e.g., lecture, discussion, demonstration and role play) and engagement with students (e.g. attentiveness, enthusiasm and positivity). Based on the video ratings, a latent profile analysis was run to identify typology of delivery quality. Five profiles were identified: holistic approach, attentive teacher-orientated approach, enthusiastic lecture approach, engaged interactive learning approach and skill practice-only approach. This study provides a descriptive typology of delivery quality while implementing a school-based substance use prevention intervention.

Random assignment of schools to groups in the drug resistance strategies rural project: some new methodological twists.

Random assignment to groups is the foundation for scientifically rigorous clinical trials. But assignment is challenging in group randomized trials when only a few units (schools) are assigned to each condition. In the DRSR project, we assigned 39 rural Pennsylvania and Ohio schools to three conditions (rural, classic, control). But even with 13 schools per condition, achieving pretest equivalence on important variables is not guaranteed. We collected data on six important school-level variables: rurality, number of grades in the school, enrollment per grade, percent white, percent receiving free/assisted lunch, and test scores. Key to our procedure was the inclusion of school-level drug use data, available for a subset of the schools. Also, key was that we handled the partial data with modern missing data techniques. We chose to create one composite stratifying variable based on the seven school-level variables available. Principal components analysis with the seven variables yielded two factors, which were averaged to form the composite inflate-suppress (CIS) score which was the basis of stratification. The CIS score was broken into three strata within each state; schools were assigned at random to the three program conditions from within each stratum, within each state. Results showed that program group membership was unrelated to the CIS score, the two factors making up the CIS score, and the seven items making up the factors. Program group membership was not significantly related to pretest measures of drug use (alcohol, cigarettes, marijuana, chewing tobacco; smallest p > .15), thus verifying that pretest equivalence was achieved.

The conceptualization and communication of risk among rural appalachian adolescents.

This study uses a meta-theoretical perspective for examining risk perceptions and behavior in the rural Appalachian cultural context, an area that remains largely unexplored. The authors conducted in-depth interviews with 113 rural adolescents to describe how youth conceptualize risk and how risk is communicated in the rural environment. Analyses revealed adolescents viewed behavior as risky when they had personal or vicarious experiences resulting in a loss of control or physical harm. Elements of the rural Appalachian culture including activities, familism, and community ties can prevent and promote adolescent risk taking in various forms. This study demonstrates the conceptualization of risk and messages about risk are culturally situated and communicatively devised and enacted. The implications of these findings for adolescent risk prevention programs are discussed.

Narrative means to preventative ends: a narrative engagement framework for designing prevention interventions.

This article describes a Narrative Engagement Framework (NEF) for guiding communication-based prevention efforts. This framework suggests that personal narratives have distinctive capabilities in prevention. The article discusses the concept of narrative, links narrative to prevention, and discusses the central role of youth in developing narrative interventions. As illustration, the authors describe how the NEF is applied in the keepin' it REAL adolescent drug prevention curriculum, pose theoretical directions, and offer suggestions for future work in prevention communication.