RESUMO
Gamification is a promising approach to reducing misinformation susceptibility. Previous research has found that "inoculation" games such as Bad News and Harmony Square help build cognitive resistance against misinformation. However, recent research has offered two important nuances: a potentially inadvertent impact of such games on people's evaluation of non-misinformation ("real news") and exponential decay over time if no memory-strengthening exercise is provided. We address these issues in two preregistered lab experiments (N1 = 191, N2 = 321) and four quasi-experimental in-game surveys implemented in Harmony Square (N3 = 559) and Bad News (N4 = 2,558, N5 = 419, N6 = 882). In Experiments 1 and 2, we test if providing different types of feedback after playing Bad News enhances discriminative ability of misinformation and real news 1 week postgameplay and find that doing so resulted in homogeneously better accuracy at identifying both misinformation and non-misinformation compared with a control condition, which played Bad News without feedback. In Experiments 3-6, we implemented two different types of feedback exercises in the Harmony Square and Bad News games and find that this significantly boosts discernment compared with playing the game without a feedback exercise, primarily by improving accuracy at detecting real news. We confirm these results using signal detection theory. We conclude that feedback exercises boost the effectiveness of gamified misinformation interventions, likely due to an improved learning environment. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Assuntos
Comunicação , Humanos , Masculino , Feminino , Adulto , Adulto Jovem , Retroalimentação Psicológica , AdolescenteAssuntos
Comunicação , Enganação , Democracia , Política , Humanos , Reprodutibilidade dos Testes , Pesquisadores , Mudança SocialRESUMO
This JAMA Insights in the Communicating Medicine series explores the concept of "prebunking," a psychological inoculation technique that could help prevent the spread of misinformation.
Assuntos
Comunicação , Educação em Saúde , Humanos , COVID-19 , Comunicação Persuasiva , Comunicação em Saúde/métodos , Educação em Saúde/métodosRESUMO
Although misinformation exposure takes place within a social context, significant conclusions have been drawn about misinformation susceptibility through studies that largely examine judgements in a social vacuum. Bridging the gap between social influence research and the cognitive science of misinformation, we examine the mechanisms through which social context impacts misinformation susceptibility across 5 experiments (N = 20,477). We find that social cues only impact individual judgements when they influence perceptions of wider social consensus, and that source similarity only biases news consumers when the source is high in credibility. Specifically, high and low engagement cues ('likes') reduced misinformation susceptibility relative to a control, and endorsement cues increased susceptibility, but discrediting cues had no impact. Furthermore, political ingroup sources increased susceptibility if the source was high in credibility, but political outgroup sources had no effect relative to a control. This work highlights the importance of studying cognitive processes within a social context, as judgements of (mis)information change when embedded in the social world. These findings further underscore the need for multifaceted interventions that take account of the social context in which false information is processed to effectively mitigate the impact of misinformation on the public.
Assuntos
Sinais (Psicologia) , Mídias Sociais , Comunicação , Comunicação PersuasivaRESUMO
Interest in the psychology of misinformation has exploded in recent years. Despite ample research, to date there is no validated framework to measure misinformation susceptibility. Therefore, we introduce Verification done, a nuanced interpretation schema and assessment tool that simultaneously considers Veracity discernment, and its distinct, measurable abilities (real/fake news detection), and biases (distrust/naïvité-negative/positive judgment bias). We then conduct three studies with seven independent samples (Ntotal = 8504) to show how to develop, validate, and apply the Misinformation Susceptibility Test (MIST). In Study 1 (N = 409) we use a neural network language model to generate items, and use three psychometric methods-factor analysis, item response theory, and exploratory graph analysis-to create the MIST-20 (20 items; completion time < 2 minutes), the MIST-16 (16 items; < 2 minutes), and the MIST-8 (8 items; < 1 minute). In Study 2 (N = 7674) we confirm the internal and predictive validity of the MIST in five national quota samples (US, UK), across 2 years, from three different sampling platforms-Respondi, CloudResearch, and Prolific. We also explore the MIST's nomological net and generate age-, region-, and country-specific norm tables. In Study 3 (N = 421) we demonstrate how the MIST-in conjunction with Verification done-can provide novel insights on existing psychological interventions, thereby advancing theory development. Finally, we outline the versatile implementations of the MIST as a screening tool, covariate, and intervention evaluation framework. As all methods are transparently reported and detailed, this work will allow other researchers to create similar scales or adapt them for any population of interest.
Assuntos
Comunicação , Julgamento , Humanos , Psicometria/métodos , Idioma , Análise FatorialRESUMO
[This corrects the article DOI: 10.1098/rsos.211719.][This corrects the article DOI: 10.1098/rsos.211719.].
RESUMO
Democracy relies on a shared body of knowledge among citizens, for example trust in elections and reliable knowledge to inform policy-relevant debate. We review the evidence for widespread disinformation campaigns that are undermining this shared knowledge. We establish a common pattern by which science and scientists are discredited and how the most recent frontier in those attacks involves researchers in misinformation itself. We list several ways in which psychology can contribute to countermeasures.
Assuntos
Comunicação , Democracia , Humanos , PolíticaRESUMO
Building misinformation resilience at scale continues to pose a challenge. Gamified "inoculation" interventions have shown promise in improving people's ability to recognize manipulation techniques commonly used in misinformation, but so far few interventions exist that tackle multimodal misinformation (e.g., videos, images). We developed a game called Cat Park, in which players learn about five manipulation techniques (trolling, emotional manipulation, amplification, polarization, and conspiracism), and how misinformation can spread through images. To test the game's efficacy, we conducted a conceptual replication (N = 380) of Roozenbeek and van der Linden's 2020 study about Harmony Square, with the same study design, item set, and hypotheses. Like the original study, we find that people who play Cat Park find misinformation significantly less reliable post-gameplay (d = 0.95, p < 0.001) compared to a control group, and are significantly less willing to share misinformation with people in their network (d = 0.54, p < 0.001). These effects are robust across different covariates. However, unlike the original study, Cat Park players do not become significantly more confident in their ability to identify misinformation (p = 0.204, d = - 0.13). We did not find that the game increases people's self-reported motivation and confidence to counter misinformation online.
Assuntos
Emoções , Aprendizagem , Humanos , Motivação , Refração Ocular , Tilia , ComunicaçãoRESUMO
Background: An infodemic is excess information, including false or misleading information, that spreads in digital and physical environments during a public health emergency. The COVID-19 pandemic has been accompanied by an unprecedented global infodemic that has led to confusion about the benefits of medical and public health interventions, with substantial impact on risk-taking and health-seeking behaviors, eroding trust in health authorities and compromising the effectiveness of public health responses and policies. Standardized measures are needed to quantify the harmful impacts of the infodemic in a systematic and methodologically robust manner, as well as harmonizing highly divergent approaches currently explored for this purpose. This can serve as a foundation for a systematic, evidence-based approach to monitoring, identifying, and mitigating future infodemic harms in emergency preparedness and prevention. Objective: In this paper, we summarize the Fifth World Health Organization (WHO) Infodemic Management Conference structure, proceedings, outcomes, and proposed actions seeking to identify the interdisciplinary approaches and frameworks needed to enable the measurement of the burden of infodemics. Methods: An iterative human-centered design (HCD) approach and concept mapping were used to facilitate focused discussions and allow for the generation of actionable outcomes and recommendations. The discussions included 86 participants representing diverse scientific disciplines and health authorities from 28 countries across all WHO regions, along with observers from civil society and global public health-implementing partners. A thematic map capturing the concepts matching the key contributing factors to the public health burden of infodemics was used throughout the conference to frame and contextualize discussions. Five key areas for immediate action were identified. Results: The 5 key areas for the development of metrics to assess the burden of infodemics and associated interventions included (1) developing standardized definitions and ensuring the adoption thereof; (2) improving the map of concepts influencing the burden of infodemics; (3) conducting a review of evidence, tools, and data sources; (4) setting up a technical working group; and (5) addressing immediate priorities for postpandemic recovery and resilience building. The summary report consolidated group input toward a common vocabulary with standardized terms, concepts, study designs, measures, and tools to estimate the burden of infodemics and the effectiveness of infodemic management interventions. Conclusions: Standardizing measurement is the basis for documenting the burden of infodemics on health systems and population health during emergencies. Investment is needed into the development of practical, affordable, evidence-based, and systematic methods that are legally and ethically balanced for monitoring infodemics; generating diagnostics, infodemic insights, and recommendations; and developing interventions, action-oriented guidance, policies, support options, mechanisms, and tools for infodemic managers and emergency program managers.
RESUMO
The extent to which belief in (mis)information reflects lack of knowledge versus a lack of motivation to be accurate is unclear. Here, across four experiments (n = 3,364), we motivated US participants to be accurate by providing financial incentives for correct responses about the veracity of true and false political news headlines. Financial incentives improved accuracy and reduced partisan bias in judgements of headlines by about 30%, primarily by increasing the perceived accuracy of true news from the opposing party (d = 0.47). Incentivizing people to identify news that would be liked by their political allies, however, decreased accuracy. Replicating prior work, conservatives were less accurate at discerning true from false headlines than liberals, yet incentives closed the gap in accuracy between conservatives and liberals by 52%. A non-financial accuracy motivation intervention was also effective, suggesting that motivation-based interventions are scalable. Altogether, these results suggest that a substantial portion of people's judgements of the accuracy of news reflects motivational factors.
Assuntos
Julgamento , Motivação , Humanos , EmoçõesRESUMO
The unchecked spread of misinformation is recognized as an increasing threat to public, scientific and democratic health. Online networks are a contributing cause of this spread, with echo chambers and polarization indicative of the interplay between the search behaviours of users and reinforcement processes within the system they inhabit. Recent empirical work has focused on interventions aimed at inoculating people against misinformation, yielding success on the individual level. However, given the evolving, dynamic information context of online networks, important questions remain regarding how such inoculation interventions interact with network systems. Here we use an agent-based model of a social network populated with belief-updating users. We find that although equally rational agents may be assisted by inoculation interventions to reject misinformation, even among such agents, intervention efficacy is temporally sensitive. We find that as beliefs disseminate, users form self-reinforcing echo chambers, leading to belief consolidation-irrespective of their veracity. Interrupting this process requires 'front-loading' of inoculation interventions by targeting critical thresholds of network users before consolidation occurs. We further demonstrate the value of harnessing tipping point dynamics for herd immunity effects, and note that inoculation processes do not necessarily lead to increased rates of 'false-positive' rejections of truthful communications.
RESUMO
Online misinformation continues to have adverse consequences for society. Inoculation theory has been put forward as a way to reduce susceptibility to misinformation by informing people about how they might be misinformed, but its scalability has been elusive both at a theoretical level and a practical level. We developed five short videos that inoculate people against manipulation techniques commonly used in misinformation: emotionally manipulative language, incoherence, false dichotomies, scapegoating, and ad hominem attacks. In seven preregistered studies, i.e., six randomized controlled studies (n = 6464) and an ecologically valid field study on YouTube (n = 22,632), we find that these videos improve manipulation technique recognition, boost confidence in spotting these techniques, increase people's ability to discern trustworthy from untrustworthy content, and improve the quality of their sharing decisions. These effects are robust across the political spectrum and a wide variety of covariates. We show that psychological inoculation campaigns on social media are effective at improving misinformation resilience at scale.
RESUMO
In recent years, numerous psychological interventions have been developed to reduce susceptibility to misinformation. Inoculation theory has become an increasingly common framework for reducing susceptibility to both individual examples of misinformation (issue-based inoculation) and to the techniques and strategies that are commonly used to mislead or misinform people (technique-based inoculation). In this study, we address two open questions related to technique-based inoculation in two separate experiments (total n = 2188; convenience sample recruited via the Bad News online game platform): (i) can technique-based inoculation effectively reduce susceptibility to real-world misinformation that went viral on social media? and (ii) can technique-based inoculation confer cross-protection against misinformation that does not make use of any of the techniques against which people were inoculated? We find that playing a 15 min game confers psychological resistance against real-world misinformation that makes use of manipulation techniques against which people were inoculated (Cohen's d = 0.37, Cohen's U 3 = 64.4%, p < 0.001), and that cross-protection is achieved but at a reduced effect size (d = 0.10, U 3 = 54.0%, p = 0.001).
RESUMO
Understanding how vaccine hesitancy relates to online behavior is crucial for addressing current and future disease outbreaks. We combined survey data measuring attitudes toward the COVID-19 vaccine with Twitter data in two studies (N 1 = 464 Twitter users, N 2 = 1,600 Twitter users) with preregistered hypotheses to examine how real-world social media behavior is associated with vaccine hesitancy in the United States (US) and the United Kingdom (UK). In Study 1, we found that following the accounts of US Republican politicians or hyper-partisan/low-quality news sites were associated with lower confidence in the COVID-19 vaccine-even when controlling for key demographics such as self-reported political ideology and education. US right-wing influencers (e.g. Candace Owens, Tucker Carlson) had followers with the lowest confidence in the vaccine. Network analysis revealed that participants who were low and high in vaccine confidence separated into two distinct communities (or "echo chambers"), and centrality in the more right-wing community was associated with vaccine hesitancy in the US, but not in the UK. In Study 2, we found that one's likelihood of not getting the vaccine was associated with retweeting and favoriting low-quality news websites on Twitter. Altogether, we show that vaccine hesitancy is associated with following, sharing, and interacting with low-quality information online, as well as centrality within a conservative-leaning online community in the US. These results illustrate the potential challenges of encouraging vaccine uptake in a polarized social media environment.
RESUMO
As part of the Systematizing Confidence in Open Research and Evidence (SCORE) program, the present study consisted of a two-stage replication test of a central finding by Pennycook et al. (2020), namely that asking people to think about the accuracy of a single headline improves "truth discernment" of intentions to share news headlines about COVID-19. The first stage of the replication test (n = 701) was unsuccessful (p = .67). After collecting a second round of data (additional n = 882, pooled N = 1,583), we found a small but significant interaction between treatment condition and truth discernment (uncorrected p = .017; treatment: d = 0.14, control: d = 0.10). As in the target study, perceived headline accuracy correlated with treatment impact, so that treatment-group participants were less willing to share headlines that were perceived as less accurate. We discuss potential explanations for these findings and an unreported change in the hypothesis (but not the analysis plan) from the preregistration in the original study.
Assuntos
COVID-19 , Meios de Comunicação de Massa , Pensamento , Humanos , Disseminação de Informação , Intenção , Meios de Comunicação de Massa/normas , Reprodutibilidade dos Testes , Revelação da VerdadeRESUMO
In recent years, interest in the psychology of fake news has rapidly increased. We outline the various interventions within psychological science aimed at countering the spread of fake news and misinformation online, focusing primarily on corrective (debunking) and pre-emptive (prebunking) approaches. We also offer a research agenda of open questions within the field of psychological science that relate to how and why fake news spreads and how best to counter it: the longevity of intervention effectiveness; the role of sources and source credibility; whether the sharing of fake news is best explained by the motivated cognition or the inattention accounts; and the complexities of developing psychometrically validated instruments to measure how interventions affect susceptibility to fake news at the individual level.
Assuntos
Enganação , Transtornos Mentais , Cognição , Comunicação , HumanosRESUMO
Online misinformation is a pervasive global problem. In response, psychologists have recently explored the theory of psychological inoculation: If people are preemptively exposed to a weakened version of a misinformation technique, they can build up cognitive resistance. This study addresses two unanswered methodological questions about a widely adopted online "fake news" inoculation game, Bad News. First, research in this area has often looked at pre- and post-intervention difference scores for the same items, which may imply that any observed effects are specific to the survey items themselves (item effects). Second, it is possible that using a pretest influences the outcome variable of interest, or that the pretest may interact with the intervention (testing effects). We investigate both item and testing effects in two online studies (total N = 2,159) using the Bad News game. For the item effect, we examine if inoculation effects are still observed when different items are used in the pre- and posttest. To examine the testing effect, we use a Solomon's Three Group Design. We find that inoculation interventions are somewhat influenced by item effects, and not by testing effects. We show that inoculation interventions are effective at improving people's ability to spot misinformation techniques and that the Bad News game does not make people more skeptical of real news. We discuss the larger relevance of these findings for evaluating real-world psychological interventions.
RESUMO
This study investigates the long-term effectiveness of active psychological inoculation as a means to build resistance against misinformation. Using 3 longitudinal experiments (2 preregistered), we tested the effectiveness of Bad News, a real-world intervention in which participants develop resistance against misinformation through exposure to weakened doses of misinformation techniques. In 3 experiments (NExp1 = 151, NExp2 = 194, NExp3 = 170), participants played either Bad News (inoculation group) or Tetris (gamified control group) and rated the reliability of news headlines that either used a misinformation technique or not. We found that participants rate fake news as significantly less reliable after the intervention. In Experiment 1, we assessed participants at regular intervals to explore the longevity of this effect and found that the inoculation effect remains stable for at least 3 months. In Experiment 2, we sought to replicate these findings without regular testing and found significant decay over a 2-month time period so that the long-term inoculation effect was no longer significant. In Experiment 3, we replicated the inoculation effect and investigated whether long-term effects could be due to item-response memorization or the fake-to-real ratio of items presented, but found that this is not the case. We discuss implications for inoculation theory and psychological research on misinformation. (PsycInfo Database Record (c) 2021 APA, all rights reserved).