Assessing message deployment during public health emergencies through social media: An empirical test of optimizing content for effective dissemination.

BACKGROUND: During an infodemic, the need for timely, reliable, and accessible information is crucial to combat the proliferation of health misinformation. Message testing can provide vital information to make data-informed decisions, but traditional methods tend to be time and resource intensive. Recognizing this need, we developed the Rapid Message Testing at Scale (RMTS) approach to allow communicators to repurpose existing social media advertising tools and understand the full spectrum of audience engagement. OBJECTIVE: We had two main objectives: a) to demonstrate the use of the RMTS approach for message testing, especially when resources are limited and there is a need to act in a timely manner, and (b) to propose and test the efficacy of an outcome variable that measures engagement along a continuum of viewing experience. METHODS: We developed 12 versions of a single video that was created for a vaccine confidence project in India. We manipulated video length, aspect ratio, and use of subtitles. The videos were tested across four demographic groups (women/men, younger/older). We assessed user engagement along a continuum of viewing experience: getting attention, sustaining attention, conveying the message, and inspiring action. These were measured by percentage of video watched and clicks on the call-to-action link. RESULTS: The video ads were placed on Facebook over four consecutive days at the cost of $450 (U.S.) and garnered a total of 3.34 million impressions. Overall, we found that the best performing video was the shorter version presented in portrait aspect ratio and without subtitles. There was a significant but small association between the length of the video and users' level of engagement at key points along the continuum of viewing experience (N=1,032,888; 〖χ^2〗_4=48,261.97; P<.001; V=.22). We found that for the longer video, those with subtitles held viewers longer after 25% video watch time than those without subtitles (n=15,597; 〖χ^2〗_1=7.33; P<.01; V=.02). While we found some significant associations between the aspect ratio, the use of subtitles, and the number of users watching the video and clicking on the call-to-action link, the effect size for those were extremely small. CONCLUSIONS: This test served as a proof of concept for the RMTS approach. We obtained rapid feedback on formal message attributes from a very large sample in a very short timeframe. The results of this test reinforce the need for platform-specific tailoring of communications. While our data showed a general preference for the short video in portrait orientation and without subtitles among our target audiences on Facebook, that may not necessarily be the case in other social media platforms such as YouTube or TikTok, where users go primarily to watch videos. RMTS testing highlights nuances that communication professionals can address instead of being limited to a 'one size fits all' approach.

The Be REAL Framework: Enhancing Relationship-Building Skills for Community Health Workers.

Trust plays an integral part in the effective functioning of public health systems. During the COVID-19 pandemic, distrust of public health fueled vaccine hesitancy and created additional barriers to immunization. Although most Americans have received at least one COVID-19 vaccine, the percentage of fully immunized adults remains suboptimal. To reach vaccine-hesitant communities, it is vital that public health be worthy of trust. As trusted members of their communities, community health workers (CHWs) can serve as ideal messengers and conversation partners for vaccination decision-making. We developed the Be REAL framework and training materials to prepare CHWs to work with vaccine-hesitant communities nationwide. Through the four steps of "Relate," "Explore," "Assist," and "Leave (the door open)," CHWs were taught to prioritize relationship building as a primary goal. In this shift from focusing on adherence to public health recommendations (e.g., get vaccinated) to building relationships, the value of vaccine uptake is secondary to the quality of the relationship being formed. The Be REAL framework facilitates CHWs harnessing the power they already possess. The goal of the Be REAL framework is to foster true partnership between CHWs and community members, which in turn can help increase trust in the broader public health system beyond adherence to a specific recommendation.

Fighting the infodemic: the 4 i Framework for Advancing Communication and Trust.

BACKGROUND: The proliferation of false and misleading health claims poses a major threat to public health. This ongoing "infodemic" has prompted numerous organizations to develop tools and approaches to manage the spread of falsehoods and communicate more effectively in an environment of mistrust and misleading information. However, these tools and approaches have not been systematically characterized, limiting their utility. This analysis provides a characterization of the current ecosystem of infodemic management strategies, allowing public health practitioners, communicators, researchers, and policy makers to gain an understanding of the tools at their disposal. METHODS: A multi-pronged search strategy was used to identify tools and approaches for combatting health-related misinformation and disinformation. The search strategy included a scoping review of academic literature; a review of gray literature from organizations involved in public health communications and misinformation/disinformation management; and a review of policies and infodemic management approaches from all U.S. state health departments and select local health departments. A team of annotators labelled the main feature(s) of each tool or approach using an iteratively developed list of tags. RESULTS: We identified over 350 infodemic management tools and approaches. We introduce the 4 i Framework for Advancing Communication and Trust (4 i FACT), a modified social-ecological model, to characterize different levels of infodemic intervention: informational, individual, interpersonal, and institutional. Information-level strategies included those designed to amplify factual information, fill information voids, debunk false information, track circulating information, and verify, detect, or rate the credibility of information. Individual-level strategies included those designed to enhance information literacy and prebunking/inoculation tools. Strategies at the interpersonal/community level included resources for public health communicators and community engagement approaches. Institutional and structural approaches included resources for journalists and fact checkers, tools for managing academic/scientific literature, resources for infodemic researchers/research, resources for infodemic managers, social media regulation, and policy/legislation. CONCLUSIONS: The 4 i FACT provides a useful way to characterize the current ecosystem of infodemic management strategies. Recognizing the complex and multifaceted nature of the ongoing infodemic, efforts should be taken to utilize and integrate strategies across all four levels of the modified social-ecological model.

Production of vaccination videos in India: learnings from a science-art partnership.

BACKGROUND: Cross-cultural communication, often conceptualized along culture and language dimensions, is an important issue for collaborative teams that include both scientists and artists. Such teams must balance the standardization needs of rigorous scientific methods, on the one hand, with openness for artistic creativity, on the other. The scientific literature does not provide clear guidance on how to structure such collaborations. DISCUSSION: We created eight videos manipulating the type of appeal, message tone, and gender of the vaccine promoter in a 2 × 2 × 2 between-subjects experiment. The four stages of the filmmaking process were 1) conceptualizing filmmaking and script writing through a scientific lens, 2) pilot testing and finalizing the script, 3) video production and editing, and 4) dissemination. We describe the process and learnings from a collaboration that included filmmakers, researchers, and vaccine experts from India and the United States in producing, disseminating, and evaluating videos that promoted vaccine uptake in Odisha, India. CONCLUSIONS: When projects require close collaborations between scientists and artists, committing to a unified vision is essential for facilitating open, bidirectional communication and building trust between the partners. Clearly denoting research boundaries ensures that the scientific needs of the project are met while simultaneously welcoming space for the filmmakers' creativity, fostering a sense of ownership, and enhancing the final product.

Facebook Pages, the "Disneyland" Measles Outbreak, and Promotion of Vaccine Refusal as a Civil Right, 2009-2019.

Objectives. To understand changes in how Facebook pages frame vaccine opposition.Methods. We categorized 204 Facebook pages expressing vaccine opposition, extracting public posts through November 20, 2019. We analyzed posts from October 2009 through October 2019 to examine if pages' content was coalescing.Results. Activity in pages promoting vaccine choice as a civil liberty increased in January 2015, April 2016, and January 2019 (t[76] = 11.33 [P < .001]; t[46] = 7.88 [P < .001]; and t[41] = 17.27 [P < .001], respectively). The 2019 increase was strongest in pages mentioning US states (t[41] = 19.06; P < .001). Discussion about vaccine safety decreased (rs[119] = -0.61; P < .001) while discussion about civil liberties increased (rs[119] = 0.33; Py < .001]). Page categories increasingly resembled one another (civil liberties: rs[119] = -0.50 [P < .001]; alternative medicine: rs[84] = -0.77 [P < .001]; conspiracy theories: rs[119] = -0.46 [P < .001]; morality: rs[106] = -0.65 [P < .001]; safety and efficacy: rs[119] = -0.46 [P < .001]).Conclusions. The "Disneyland" measles outbreak drew vaccine opposition into the political mainstream, followed by promotional campaigns conducted in pages framing vaccine refusal as a civil right. Political mobilization in state-focused pages followed in 2019.Public Health Implications. Policymakers should expect increasing attempts to alter state legislation associated with vaccine exemptions, potentially accompanied by fiercer lobbying from specific celebrities.

Adapting and Extending a Typology to Identify Vaccine Misinformation on Twitter.

Objectives. To adapt and extend an existing typology of vaccine misinformation to classify the major topics of discussion across the total vaccine discourse on Twitter.Methods. Using 1.8 million vaccine-relevant tweets compiled from 2014 to 2017, we adapted an existing typology to Twitter data, first in a manual content analysis and then using latent Dirichlet allocation (LDA) topic modeling to extract 100 topics from the data set.Results. Manual annotation identified 22% of the data set as antivaccine, of which safety concerns and conspiracies were the most common themes. Seventeen percent of content was identified as provaccine, with roughly equal proportions of vaccine promotion, criticizing antivaccine beliefs, and vaccine safety and effectiveness. Of the 100 LDA topics, 48 contained provaccine sentiment and 28 contained antivaccine sentiment, with 9 containing both.Conclusions. Our updated typology successfully combines manual annotation with machine-learning methods to estimate the distribution of vaccine arguments, with greater detail on the most distinctive topics of discussion. With this information, communication efforts can be developed to better promote vaccines and avoid amplifying antivaccine rhetoric on Twitter.

Malicious Actors on Twitter: A Guide for Public Health Researchers.

Social bots and other malicious actors have a significant presence on Twitter. It is increasingly clear that some of their activities can have a negative impact on public health. This guide provides an overview of the types of malicious actors currently active on Twitter by highlighting the characteristic behaviors and strategies employed. It covers both automated accounts (including traditional spambots, social spambots, content polluters, and fake followers) and human users (primarily trolls). It also addresses the unique threat of state-sponsored trolls. We utilize examples from our own research on vaccination to illustrate. The diversity of malicious actors and their multifarious goals adds complexity to research efforts that use Twitter. Bots are now part of the social media landscape, and although it may not be possible to stop their influence, it is vital that public health researchers and practitioners recognize the potential harms and develop strategies to address bot- and troll-driven messages.

Home remedy use and influenza vaccination among African American and white adults: An exploratory study.

Racial disparities in influenza vaccination persist between African American and White adults. It is critical to explore the reasons behind this disparity, which may be linked to the use of "folk" or home remedies for illness prevention and treatment. For this study, The GfK Group was contracted to conduct a nationally-representative survey (n = 819 African American and 838 White respondents). Respondents were asked about behaviors, attitudes, and risk perception related to the influenza vaccine, as well as frequency of home remedy use. Results were analyzed using adjusted logistic regression with 95% confidence intervals. In comparison to those who never use home remedies, those who use home remedies often or almost always were less likely to get vaccinated for influenza (respectively, OR = 0.70, CI 0.49, 0.99; OR = 0.27, CI 0.15, 0.49), less likely to be in favor of the vaccine (OR = 0.47, CI 0.33, 0.67; OR = 0.19, CI 0.10, 0.34), less likely to trust the vaccine (OR = 0.42, CI 0.29, 0.61; OR = 0.34, CI 0.20, 0.61), and more likely to perceive higher risk of vaccine side effects (OR = 1.79, CI 1.19, 2.68; OR = 4.00, CI 2.38, 6.73). These associations did not vary by race. Home remedy users may hold negative views toward the influenza vaccine, such that a combination of little trust in the vaccine process, and overestimation of risk associated with the vaccine itself, may contribute to vaccine refusal. Health care professionals can use these findings to tailor advice toward individuals with a preference for home remedy use to allay fears and correct misconceptions surrounding influenza and its vaccine.

Older African Americans and the HIV Care Continuum: A Systematic Review of the Literature, 2003-2018.

Evidence suggests that racial disparities in the HIV care continuum persist in older age groups, particularly among African Americans. The objective of this systematic review was to identify factors that facilitate or hinder older African Americans' engagement in the HIV care continuum. For studies published between 2003 and 2018, we: (1) searched databases using keywords, (2) excluded non-peer-reviewed studies, (3) limited findings to older African Americans and the HIV care continuum, and (4) retrieved and summarized data focused on barriers and facilitators of the HIV care continuum. Among the 1023 studies extracted, 13 were included: diagnosis/testing (n = 1), engagement in care (n = 7), and antiretroviral adherence (n = 5). Barriers included lack of HIV risk awareness, routine testing, and healthcare access, stigma, and multimorbidities. Social support, health/medication literacy, and increased self-efficacy facilitated engagement. A targeted focus on older African Americans is needed to achieve national goals of improving HIV care and treatment outcomes.

Weaponized Health Communication: Twitter Bots and Russian Trolls Amplify the Vaccine Debate.

OBJECTIVES: To understand how Twitter bots and trolls ("bots") promote online health content. METHODS: We compared bots' to average users' rates of vaccine-relevant messages, which we collected online from July 2014 through September 2017. We estimated the likelihood that users were bots, comparing proportions of polarized and antivaccine tweets across user types. We conducted a content analysis of a Twitter hashtag associated with Russian troll activity. RESULTS: Compared with average users, Russian trolls (χ2(1) = 102.0; P < .001), sophisticated bots (χ2(1) = 28.6; P < .001), and "content polluters" (χ2(1) = 7.0; P < .001) tweeted about vaccination at higher rates. Whereas content polluters posted more antivaccine content (χ2(1) = 11.18; P < .001), Russian trolls amplified both sides. Unidentifiable accounts were more polarized (χ2(1) = 12.1; P < .001) and antivaccine (χ2(1) = 35.9; P < .001). Analysis of the Russian troll hashtag showed that its messages were more political and divisive. CONCLUSIONS: Whereas bots that spread malware and unsolicited content disseminated antivaccine messages, Russian trolls promoted discord. Accounts masquerading as legitimate users create false equivalency, eroding public consensus on vaccination. Public Health Implications. Directly confronting vaccine skeptics enables bots to legitimize the vaccine debate. More research is needed to determine how best to combat bot-driven content.

Discordance Between Human Papillomavirus Twitter Images and Disparities in Human Papillomavirus Risk and Disease in the United States: Mixed-Methods Analysis.

BACKGROUND: Racial and ethnic minorities are disproportionately affected by human papillomavirus (HPV)-related cancer, many of which could have been prevented with vaccination. Yet, the initiation and completion rates of HPV vaccination remain low among these populations. Given the importance of social media platforms for health communication, we examined US-based HPV images on Twitter. We explored inconsistencies between the demographics represented in HPV images and the populations that experience the greatest burden of HPV-related disease. OBJECTIVE: The objective of our study was to observe whether HPV images on Twitter reflect the actual burden of disease by select demographics and determine to what extent Twitter accounts utilized images that reflect the burden of disease in their health communication messages. METHODS: We identified 456 image tweets about HPV that contained faces posted by US users between November 11, 2014 and August 8, 2016. We identified images containing at least one human face and utilized Face++ software to automatically extract the gender, age, and race of each face. We manually annotated the source accounts of these tweets into 3 types as follows: government (38/298, 12.8%), organizations (161/298, 54.0%), and individual (99/298, 33.2%) and topics (news, health, and other) to examine how images varied by message source. RESULTS: Findings reflected the racial demographics of the US population but not the disease burden (795/1219, 65.22% white faces; 140/1219, 11.48% black faces; 71/1219, 5.82% Asian faces; and 213/1219, 17.47% racially ambiguous faces). Gender disparities were evident in the image faces; 71.70% (874/1219) represented female faces, whereas only 27.89% (340/1219) represented male faces. Among the 11-26 years age group recommended to receive HPV vaccine, HPV images contained more female-only faces (214/616, 34.3%) than males (37/616, 6.0%); the remainder of images included both male and female faces (365/616, 59.3%). Gender and racial disparities were present across different image sources. Faces from government sources were more likely to depict females (n=44) compared with males (n=16). Of male faces, 80% (12/15) of youth and 100% (1/1) of adults were white. News organization sources depicted high proportions of white faces (28/38, 97% of female youth and 12/12, 100% of adult males). Face++ identified fewer faces compared with manual annotation because of limitations with detecting multiple, small, or blurry faces. Nonetheless, Face++ achieved a high degree of accuracy with respect to gender, race, and age compared with manual annotation. CONCLUSIONS: This study reveals critical differences between the demographics reflected in HPV images and the actual burden of disease. Racial minorities are less likely to appear in HPV images despite higher rates of HPV incidence. Health communication efforts need to represent populations at risk better if we seek to reduce disparities in HPV infection.

The influence of social norms on flu vaccination among African American and White adults.

Adult influenza vaccination rates remain suboptimal, particularly among African Americans. Social norms may influence vaccination behavior, but little research has focused on influenza vaccine and almost no research has focused on racially-specific norms. This mixed methods investigation utilizes qualitative interviews and focus groups (n = 118) and national survey results (n = 1643) to assess both descriptive and subjective norms surrounding influenza vaccination. Qualitative results suggest a perceived descriptive norm that 'about half' of the population gets vaccinated. Participants describe differing norms by race and vaccine behavior. Quantitative results confirm a perceived descriptive norm that 40-60% of the population gets vaccinated. Both African Americans and Whites accurately identified race-specific vaccination rates relative to the general population. Individuals who report that a majority of people around them want them to be vaccinated were significantly more likely to be vaccinated, suggesting subjective norms are influential for both White and African American adults. While perceived descriptive norms are somewhat accurate (mirroring the actual influenza vaccination rate), emphasizing a suboptimal vaccination rate may not be beneficial. Health promotion efforts, particularly those targeting African Americans, may benefit from focusing on subjective norms and encouraging friends and family members to talk about the benefits of influenza vaccination.

Intersectional stigma among midlife and older Black women living with HIV.

HIV-related stigma is a barrier to the prevention and treatment of HIV. For midlife and older Black women, the nature and intensity of HIV-related stigma may be compounded by their multiple marginalised social status based on gender, race, and age. We examined the perceptions and experiences of HIV-related stigma among midlife and older Black women living in Prince George's County, Maryland, USA. Between 2014 and 2015, we conducted semi-structured interviews with a sample of 35 midlife and older Black women living with HIV. Using a modified grounded theory approach, we explored emergent themes related to the manifestation and experience of intersectional stigma and changes in stigma experience over time. Our findings suggest that intersectional stigma is a central feature in midlife and older Black women's lives, with women reporting experiences of intersectional stigma at the interpersonal/familial, community, and institutional/structural levels. Although women acknowledged gradual acceptance of their HIV-positive status over time, they continued to experience negative responses related to gender, race, age, and disease. Our findings indicate that a more robust understanding of the impact of HIV-related stigma requires work to consider the complex manifestations of intersectional stigma among an increasingly aging population of Black women in the USA.

The Role of Risk Perception in Flu Vaccine Behavior among African-American and White Adults in the United States.

Seasonal flu vaccination rates are low for U.S. adults, with significant disparities between African and white Americans. Risk perception is a significant predictor of vaccine behavior but the research on this construct has been flawed. This study addressed critical research questions to understand the differences between African and white Americans in the role of risk perception in flu vaccine behavior: (1) What is the dimensionality of risk perception and does it differ between the two races?  (2) Were risk perceptions of white and African-American populations different and how were sociodemographic characteristics related to risk for each group? (3) What is the relation between risk perception and flu vaccine behaviors for African Americans and whites? The sample, drawn from GfK's Knowledge Panel, consisted of 838 whites and 819 African Americans. The survey instrument was developed from qualitative research. Measures of risk perception included cognitive and emotional measures of disease risk and risk of side effects from the vaccine. The online survey was conducted in March 2015. Results showed the importance of risk perception in the vaccine decision-making process for both racial groups. As expected, those who got the vaccine reported higher disease risk than those who did not. Separate cognitive and emotional factors did not materialize in this study but strong evidence was found to support the importance of considering disease risk as well as risk of the vaccine. There were significant racial differences in the way risk perception predicted behavior.

Social norms, vaccine confidence, and interpersonal communication as predictors of vaccination intentions: Findings from slum areas in Varanasi, India.

In recent years, India has seen significant improvements in childhood immunization, but rates among the urban poor remain stagnant. Disruptions during COVID-19 pandemic have created further challenges. This paper focuses on how social norms, vaccine confidence, and interpersonal communication independently and jointly affect vaccine intentions among caregivers of infants living in six slum areas in Varanasi, India. Data for this study come from the baseline assessments conducted before implementing the Happy Baby Program, an intervention to improve vaccination attitudes and intentions. In-person interviews (N = 2,058) were conducted with caretakers of children up to two years old. Analyses showed that interpersonal communication about vaccines, descriptive norms, injunctive norms, and vaccine confidence were each associated with intentions to vaccinate in both a bivariate and, except for injunctive norms, a multivariate model. In addition, we found significant interactions among these variables, suggesting that the roles of interpersonal communication and vaccine confidence attenuated the relationship between social norms and vaccination intention. Overall, our model explained 46.2 % of the variance in vaccine intention. Given the strengths of the relationships observed in this study, intervention strategies should focus on enhancing social norms and vaccine confidence to promote vaccination.

Correction: Twitter and Facebook posts about COVID-19 are less likely to spread misinformation compared to other health topics.

[This corrects the article DOI: 10.1371/journal.pone.0261768.].

Trusted information sources in the early months of the COVID-19 pandemic predict vaccination uptake over one year later.

INTRODUCTION: COVID-19 vaccine uptake has been a major barrier to stopping the pandemic in many countries with vaccine access. This longitudinal study examined the capability to predict vaccine uptake from data collected early in the pandemic before vaccines were available. METHODS: 493 US respondents completed online surveys both at baseline (March 2020) and wave 6 (June 2021), while 390 respondents completed baseline and wave 7 (November 2021) surveys. The baseline survey assessed trust in sources of COVID-19 information, social norms, perceived risk of COVID-19, skepticism about the pandemic, prevention behaviors, and conspiracy beliefs. Multivariable logistic models examined factors associated with the receipt of at least one COVID-19 vaccine dose at the two follow-ups. RESULTS: In the adjusted model of vaccination uptake at wave 6, older age (aOR = 1.02, 95 %CI = 1.00-1.04) and greater income (aOR = 1.69, 95 %CI = 1.04-2.73) was associated with positive vaccination status. High trust in state health departments and mainstream news outlets at baseline were positively associated with vaccination at wave 6, while high trust in the Whitehouse (aOR = 0.42, 95 %CI = 0.24-0.74) and belief that China purposely spread the virus (aOR = 0.66, 95 %CI = 0.46-0.96) at baseline reduced the odds of vaccination. In the adjusted model of vaccination uptake at wave 7, increased age was associated with positive vaccination status, and Black race (compared to white) was associated with negative vaccination status. High trust in the CDC and mainstream news outlets at baseline were both associated with being vaccinated at wave 7, while high trust in the Whitehouse (aOR = 0.24, 95 %CI = 0.11-0.51) and belief that the virus was spread purposefully by China (aOR = 0.60, 95 %CI = 0.39-0.93) were negatively associated with vaccination. CONCLUSIONS: These findings indicated that vaccine uptake could be predicted over a year earlier. Trust in specific sources of COVID-19 information were strong predictors, suggesting that future pandemic preparedness plans should include forums for news media, public health officials, and diverse political leaders to meet and develop coherent plans to communicate to the public early in a pandemic so that antivaccine attitudes do not flourish and become reinforced.

The efficacy of Facebook's vaccine misinformation policies and architecture during the COVID-19 pandemic.

Online misinformation promotes distrust in science, undermines public health, and may drive civil unrest. During the coronavirus disease 2019 pandemic, Facebook-the world's largest social media company-began to remove vaccine misinformation as a matter of policy. We evaluated the efficacy of these policies using a comparative interrupted time-series design. We found that Facebook removed some antivaccine content, but we did not observe decreases in overall engagement with antivaccine content. Provaccine content was also removed, and antivaccine content became more misinformative, more politically polarized, and more likely to be seen in users' newsfeeds. We explain these findings as a consequence of Facebook's system architecture, which provides substantial flexibility to motivated users who wish to disseminate misinformation through multiple channels. Facebook's architecture may therefore afford antivaccine content producers several means to circumvent the intent of misinformation removal policies.