Reduce, reuse, recycle: Introducing MetaPipeX, a framework for analyses of multi-lab data.

Multi-lab projects are large scale collaborations between participating data collection sites that gather empirical evidence and (usually) analyze that evidence using meta-analyses. They are a valuable form of scientific collaboration, produce outstanding data sets and are a great resource for third-party researchers. Their data may be reanalyzed and used in research synthesis. Their repositories and code could provide guidance to future projects of this kind. But, while multi-labs are similar in their structure and aggregate their data using meta-analyses, they deploy a variety of different solutions regarding the storage structure in the repositories, the way the (analysis) code is structured and the file-formats they provide. Continuing this trend implies that anyone who wants to work with data from multiple of these projects, or combine their datasets, is faced with an ever-increasing complexity. Some of that complexity could be avoided. Here, we introduce MetaPipeX, a standardized framework to harmonize, document and analyze multi-lab data. It features a pipeline conceptualization of the analysis and documentation process, an R-package that implements both and a Shiny App (https://www.apps.meta-rep.lmu.de/metapipex/) that allows users to explore and visualize these data sets. We introduce the framework by describing its components and applying it to a practical example. Engaging with this form of collaboration and integrating it further into research practice will certainly be beneficial to quantitative sciences and we hope the framework provides a structure and tools to reduce effort for anyone who creates, re-uses, harmonizes or learns about multi-lab replication projects.

Eye tracking: empirical foundations for a minimal reporting guideline.

In this paper, we present a review of how the various aspects of any study using an eye tracker (such as the instrument, methodology, environment, participant, etc.) affect the quality of the recorded eye-tracking data and the obtained eye-movement and gaze measures. We take this review to represent the empirical foundation for reporting guidelines of any study involving an eye tracker. We compare this empirical foundation to five existing reporting guidelines and to a database of 207 published eye-tracking studies. We find that reporting guidelines vary substantially and do not match with actual reporting practices. We end by deriving a minimal, flexible reporting guideline based on empirical research (Section "An empirically based minimal reporting guideline").

Enhanced memory for negative social information in borderline personality disorder.

Biased social cognition toward an enhanced processing of negative social information might contribute to instability in interpersonal relationships. Such interpersonal dysfunctions are important for the understanding of several mental disorders, among them borderline personality disorder (BPD). To experimentally test enhanced memory retrieval of negative social information, using a newly developed variant of a looking-at-nothing paradigm, 45 BPD patients and 36 healthy women learned positive and negative personality traits of different target persons. In a translational memory test, participants were asked to use the learned information to evaluate statements about the target person. In addition to behavioral measures of memory performance, we investigated eye gaze patterns to decompose memory retrieval processes. We hypothesized that BPD patients would retrieve negative as compared to positive person information more accurately than healthy controls, and show increased eye gaze toward spatial locations where negative information was provided during the learning phase. Results pointed to a more accurate retrieval of negative person attributes in the patient group as compared with healthy controls, thereby corroborating a negativity bias in social cognition in an exemplary sample of patients with interpersonal problems. Interestingly, the observed negativity bias for person memory was associated with BPD severity, stronger expectancies to be rejected by others, and social detachment. No group differences regarding eye fixation behavior were found. We propose that enhanced retrieval of negative person information might be associated with dysfunctional cognitive schemas as well as reduced behavioral trust, and be of relevance for mental disorders characterized by interpersonal difficulties. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Source Credibility and the Biasing Effect of Narrative Information on the Perception of Vaccination Risks.

Immunization rates are below the Global Immunization Vision and Strategy established by the World Health Organization. One reason for this are anti-vaccination activists, who use the Internet to disseminate their agenda, frequently by publishing narrative reports about alleged vaccine adverse events. In health communication, the use of narrative information has been shown to be effectively persuasive. Furthermore, persuasion research indicates that the credibility of an information source may serve as a cue to discount or augment the communicated message. Thus, the present study investigated the effect of source credibility on the biasing effect of narrative information regarding the perception of vaccination risks. 265 participants were provided with statistical information (20%) regarding the occurrence of vaccine adverse events after vaccination against a fictitious disease. This was followed by 20 personalized narratives from an online forum on vaccination experiences. The authors varied the relative frequency of narratives reporting vaccine adverse events (35% vs. 85%), narrative source credibility (anti-vaccination website vs. neutral health forum), and the credibility of the statistical information (reliable data vs. unreliable data vs. control) in a between-subjects design. Results showed a stable narrative bias on risk perception that was not affected by credibility cues. However, narratives from an anti-vaccination website generally led to lower perceptions of vaccination risks.

The measurement of subjective probability: evaluating the sensitivity and accuracy of various scales.

The RISK of an event generally relates to its expected severity and the perceived probability of its occurrence. In RISK research, however, there is no standard measure for subjective probability estimates. In this study, we compared five commonly used measurement formats--two rating scales, a visual analog scale, and two numeric measures--in terms of their ability to assess subjective probability judgments when objective probabilities are available. We varied the probabilities (low vs. moderate) and severity (low vs. high) of the events to be judged as well as the presentation mode of objective probabilities (sequential presentation of singular events vs. graphical presentation of aggregated information). We employed two complementary goodness-of-fit criteria: the correlation between objective and subjective probabilities (sensitivity), and the root mean square deviations of subjective probabilities from objective values (accuracy). The numeric formats generally outperformed all other measures. The severity of events had no effect on the performance. Generally, a rise in probability led to decreases in performance. This effect, however, depended on how the objective probabilities were encoded: pictographs ensured perfect information, which improved goodness of fit for all formats and diminished this negative effect on the performance. Differences in performance between scales are thus caused only in part by characteristics of the scales themselves-they also depend on the process of encoding. Consequently, researchers should take the source of probability information into account before selecting a measure.

Effect of narrative reports about vaccine adverse events and bias-awareness disclaimers on vaccine decisions: a simulation of an online patient social network.

BACKGROUND: As the number of individuals who search for health information in interactive online environments is increasing, patient networks deserve more scientific attention. OBJECTIVE: To quantitatively examine if and how reading statistical and/or narrative information as typically displayed in patient networks (e.g., patientslikeme.com) affects decisions for pharmaceuticals. Previous work suggests that narrative information (e.g., about vaccine adverse events, VAE) affects risk perceptions and intentions. The authors compare the effect of narrative and statistical information about VAE on vaccination decisions and examine if a disclaimer reduces the narrative bias as well as if low numeracy leads to increased use of the narratives. METHOD AND DESIGN: In an online experiment, 458 participants were randomly assigned to a 3 (relative frequency of vaccine adverse events in 1, 7, or 17 of 20 cases) × 3 (type of information: narratives, summary statistics, or both) × 2 (bias awareness v. control disclaimer) between-subjects design. Measurements. Perceived risk, vaccination intention, and subjective numeracy. RESULTS: A higher relative frequency of cases reporting VAE decreased the intention to get vaccinated. This relation was mediated by increased risk perception. The type of information moderated the contents' impact: Summary statistics had the smallest impact, whereas narrative information was more influential, and the presence of both types of information had the greatest impact on risk perception. Individuals who received the bias-awareness disclaimer were less influenced by the patient network. Highly numerate individuals were generally more sensitive to the provided information independent of its format. CONCLUSIONS: Patient networks can influence vaccination decisions by delivering risk-related information. Disclaimers may help to reduce the influence if desired.

Memory indexing: a novel method for tracing memory processes in complex cognitive tasks.

We validate an eye-tracking method applicable for studying memory processes in complex cognitive tasks. The method is tested with a task on probabilistic inferences from memory. It provides valuable data on the time course of processing, thus clarifying previous results on heuristic probabilistic inference. Participants learned cue values of decision alternatives that were arranged within spatial frames. Later, they were told about the validities of cue dimensions and performed memory-based binary choice tasks: first, according to spontaneously adopted decision strategies and, subsequently, according to instructed decision strategies (a noncompensatory lexicographic strategy and a compensatory equal weighting strategy). During decision making, participants saw only the empty spatial frames without cue values. The spontaneously adopted and instructed decision strategies were reflected in discriminable gaze patterns on the empty spatial frames. When retrieving information no longer visible, participants tended to fixate on locations at which information was visible during the learning phase (the looking-at-nothing phenomenon). Gaze patterns were consistent with cue-wise and alternative-wise patterns of information search predicted for the instructed decision strategies as well as for the spontaneously adopted strategies identified based on decision outcomes. These findings extend previous results on the connection between memory and gaze. Furthermore, the successful application of memory indexing suggests its wider applicability in studying memory-based tasks.

Opportunities and challenges of Web 2.0 for vaccination decisions.

A growing number of people use the Internet to obtain health information, including information about vaccines. Websites that allow and promote interaction among users are an increasingly popular source of health information. Users of such so-called Web 2.0 applications (e.g. social media), while still in the minority, represent a growing proportion of online communicators, including vocal and active anti-vaccination groups as well as public health communicators. In this paper, the authors: define Web 2.0 and examine how it may influence vaccination decisions; discuss how anti-vaccination movements use Web 2.0 as well as the challenges Web 2.0 holds for public health communicators; describe the types of information used in these different settings; introduce the theoretical background that can be used to design effective vaccination communication in a Web 2.0 environment; make recommendations for practice and pose open questions for future research. The authors conclude that, as a result of the Internet and Web 2.0, private and public concerns surrounding vaccinations have the potential to virally spread across the globe in a quick, efficient and vivid manner. Web 2.0 may influence vaccination decisions by delivering information that alters the perceived personal risk of vaccine-preventable diseases or vaccination side-effects. It appears useful for public health officials to put effort into increasing the effectiveness of existing communication by implementing interactive, customized communication. A key step to providing successful public health communication is to identify those who are particularly vulnerable to finding and using unreliable and misleading information. Thus, it appears worthwhile that public health websites strive to be easy to find, easy to use, attractive in its presentation and readily provide the information, support and advice that the searcher is looking for. This holds especially when less knowledgeable individuals are in need of reliable information about vaccination risks and benefits.

The influence of narrative v. statistical information on perceiving vaccination risks.

BACKGROUND: Health-related information found on the Internet is increasing and impacts patient decision making, e.g. regarding vaccination decisions. In addition to statistical information (e.g. incidence rates of vaccine adverse events), narrative information is also widely available such as postings on online bulletin boards. Previous research has shown that narrative information can impact treatment decisions, even when statistical information is presented concurrently. OBJECTIVES: As the determinants of this effect are largely unknown, we will vary features of the narratives to identify mechanisms through which narratives impact risk judgments. METHODS: An online bulletin board setting provided participants with statistical information and authentic narratives about the occurrence and nonoccurrence of adverse events. Experiment 1 followed a single factorial design with 1, 2, or 4 narratives out of 10 reporting adverse events. Experiment 2 implemented a 2 (statistical risk 20% vs. 40%) × 2 (2/10 vs. 4/10 narratives reporting adverse events) × 2 (high vs. low richness) × 2 (high vs. low emotionality) between-subjects design. Dependent variables were perceived risk of side-effects and vaccination intentions. RESULTS: Experiment 1 shows an inverse relation between the number of narratives reporting adverse-events and vaccination intentions, which was mediated by the perceived risk of vaccinating. Experiment 2 showed a stronger influence of the number of narratives than of the statistical risk information. High (vs. low) emotional narratives had a greater impact on the perceived risk, while richness had no effect. IMPLICATIONS: The number of narratives influences risk judgments can potentially override statistical information about risk.

The influence of vaccine-critical websites on perceiving vaccination risks.

This large-scale Internet-experiment tests whether vaccine-critical pages raise perceptions of the riskiness of vaccinations and alter vaccination intentions. We manipulated the information environment (vaccine-critical website, control, both) and the focus of search (on vaccination risks, omission risks, no focus). Our analyses reveal that accessing vaccine-critical websites for five to 10 minutes increases the perception of risk of vaccinating and decreases the perception of risk of omitting vaccinations as well as the intentions to vaccinate. In line with the 'risk-as-feelings' approach, the affect elicited by the vaccine-critical websites was positively related to changes in risk perception.