The process of replication target selection in psychology: what to consider?

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.

Deciding what to replicate: A decision model for replication study selection under resource and knowledge constraints.

Robust scientific knowledge is contingent upon replication of original findings. However, replicating researchers are constrained by resources, and will almost always have to choose one replication effort to focus on from a set of potential candidates. To select a candidate efficiently in these cases, we need methods for deciding which out of all candidates considered would be the most useful to replicate, given some overall goal researchers wish to achieve. In this article we assume that the overall goal researchers wish to achieve is to maximize the utility gained by conducting the replication study. We then propose a general rule for study selection in replication research based on the replication value of the set of claims considered for replication. The replication value of a claim is defined as the maximum expected utility we could gain by conducting a replication of the claim, and is a function of (a) the value of being certain about the claim, and (b) uncertainty about the claim based on current evidence. We formalize this definition in terms of a causal decision model, utilizing concepts from decision theory and causal graph modeling. We discuss the validity of using replication value as a measure of expected utility gain, and we suggest approaches for deriving quantitative estimates of replication value. Our goal in this article is not to define concrete guidelines for study selection, but to provide the necessary theoretical foundations on which such concrete guidelines could be built. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

In COVID-19 Health Messaging, Loss Framing Increases Anxiety with Little-to-No Concomitant Benefits: Experimental Evidence from 84 Countries.

The COVID-19 pandemic (and its aftermath) highlights a critical need to communicate health information effectively to the global public. Given that subtle differences in information framing can have meaningful effects on behavior, behavioral science research highlights a pressing question: Is it more effective to frame COVID-19 health messages in terms of potential losses (e.g., "If you do not practice these steps, you can endanger yourself and others") or potential gains (e.g., "If you practice these steps, you can protect yourself and others")? Collecting data in 48 languages from 15,929 participants in 84 countries, we experimentally tested the effects of message framing on COVID-19-related judgments, intentions, and feelings. Loss- (vs. gain-) framed messages increased self-reported anxiety among participants cross-nationally with little-to-no impact on policy attitudes, behavioral intentions, or information seeking relevant to pandemic risks. These results were consistent across 84 countries, three variations of the message framing wording, and 560 data processing and analytic choices. Thus, results provide an empirical answer to a global communication question and highlight the emotional toll of loss-framed messages. Critically, this work demonstrates the importance of considering unintended affective consequences when evaluating nudge-style interventions.

No evidence of moral licensing in a laboratory bribe-taking task.

Moral licensing posits that previous moral acts increase the probability of behaving immorally in the future. According to this perspective, rejecting bribes, even because they are too small, would create a kind of "license" for taking (presumably larger) bribes in the future. On the other hand, the desire for consistency in behavior predicts that previous rejection of bribes will increase the probability of rejection for bribes offered in the future. Using a laboratory task modeling the decision to take a bribe, we examined how resisting and succumbing to the temptation to take a bribe affects later bribe-taking. Participants (N = 297) were offered either low bribes first and high bribes later or vice versa. Low bribes were in general rejected more often and the results showed some weak, nonsignificant evidence that bribe-taking may be influenced by the order of the sizes of offered bribes. However, there was no evidence of an increased probability of taking bribes after being offered the low bribes first and thus no evidence in support of the moral licensing effect.

Attention impairment in motor functional neurological disorders: a neuropsychological study.

OBJECTIVE: Our objective was to assess cognitive functioning across multiple cognitive domains using a standardised neuropsychological battery in patients with motor functional neurological disorders (mFND). METHODS: Thirty patients with clinically established mFND and 30 age-, sex- and education-matched control subjects underwent a thorough neuropsychological assessment evaluating (1) attention including processing speed, (2) executive functions including working memory, (3) short-term memory, (4) speech and language and (5) visuospatial functions. Performance validity tests (PVT) and self-report measures of depression, anxiety and cognitive complaints were included in the assessment. Only patients with valid test performance were included in the analysis. RESULTS: Three patients scored below the cut-off scores in PVT. Patients performed significantly worse than controls in the following areas: (1) the attention domain which included a slow processing speed (p = 0.005, Cohen's d = 0.89), (2) executive functions (p = 0.01, Cohen's d = 0.88) and (3) speech and language domains (p = 0.025, Cohen's d = 0.77). Patients with mFND showed greater intra-individual variability in cognitive performance (p = 0.005, Cohen's d = 0.94). Cognitive impairments were independent of depressive symptoms, which were higher in mFND patients. CONCLUSION: This study revealed both subjective and objective cognitive impairment in patients with mFND. The neuropsychological profile in mFND was characterised primarily by attentional impairment including a slow processing speed and a high intra-individual variability in cognitive performance. Cognitive impairment was associated with a valid test performance, highlighting that the deficits observed were not likely to be explained by a lack of effort in the patient group. Attention is considered to play a key role in mFND pathophysiology, and the results suggest that such impairments are objectively measurable.

The Challenge of Human Psychology to Effective Management of the COVID-19 Pandemic.

When it comes to the nature of the COVID-19 pandemic and the effectiveness of measures against the disease, many citizens worldwide do not trust their governments or health authorities. This brief essay discusses several psychological mechanisms which, under certain conditions, lead people to ignore important sources of information and hinder effective management of the epidemic. The paper shows that understanding psychological mechanisms, such as information neglect, cognitive dissonance, psychological reactance, and, in general, the diversity of people's thinking styles, may help leaders design more effective government communications.

Sacrificing Oneself or Another: The Difference Between Prescriptive and Normative Judgments in Moral Evaluation.

When asked whether to sacrifice oneself or another person to save others, one might think that people would consider sacrificing themselves rather than someone else as the right and appropriate course of action-thus showing an other-serving bias. So far however, most studies found instances of a self-serving bias-people say they would rather sacrifice others. In three experiments using trolley-like dilemmas, we tested whether an other-serving bias might appear as a function of judgment type. That is, participants were asked to make a prescriptive judgment (whether the described action should or should not be done) or a normative judgment (whether the action is right or wrong). We found that participants exhibited an other-serving bias only when asked whether self- or other-sacrifice is wrong. That is, when the judgment was normative and in a negative frame (in contrast to the positive frame asking whether the sacrifice is right). Otherwise, participants tended to exhibit a self-serving bias; that is, they approved sacrificing others more. The results underscore the importance of question wording and suggest that some effects on moral judgment might depend on the type of judgment.

What makes euthanasia justifiable? The role of symptoms' characteristics and interindividual differences.

The consideration of laypeople's views of conditions under which euthanasia is justifiable is important for policy decisions. In an online survey of US respondents, we examined how patient's symptoms influence justifiability of euthanasia. Euthanasia was judged more justifiable for conditions associated with physical suffering and negative impact on other people. The weight given to physical suffering and negative impact on others in evaluation of justifiability of euthanasia also differed based on personal characteristics. The results suggest that public discourse about medical assistance in dying should take into account differences in its perceived justifiability for patients with different conditions.

Predictors of Bribe-Taking: The Role of Bribe Size and Personality.

Laboratory studies allow studying the predictors of bribe-taking in a controlled setting. However, presently used laboratory tasks often lack any connection to norm violation or invite participants to role-play. A new experimental task for studying the decision to take a bribe was designed in this study to overcome these problems by embedding the opportunity for bribe-taking in an unrelated task that participants perform. Using this new experimental task, we found that refraining from harming a third party by taking a bribe was associated with lower offered bribes and higher scores of the participants on the honesty-humility scale from the HEXACO personality inventory. A trial-level analysis showed that response times were longer for trials with bribes and even longer for trials in which bribes were accepted. These results suggest that taking a bribe may require overcoming automatic honest response and support the validity of the honesty-humility scale in predicting moral behavior.

If It's Difficult to Pronounce, It Might Not Be Risky: The Effect of Fluency on Judgment of Risk Does Not Generalize to New Stimuli.

Processing fluency is used as a basis for various types of judgment. For example, previous research has shown that people judge food additives with names that are more difficult to pronounce (i.e., that are disfluent) to be more harmful. We explored the possibility that the association between disfluency and perceived harmfulness might be in the opposite direction for some categories of stimuli. Although we found some support for this hypothesis, an improved analysis and further studies indicated that the effect was strongly dependent on the stimuli used. We then used stimulus sampling and showed that the original association between fluency and perceived safety was not replicable with the newly constructed stimuli. We found the association between fluency and perceived safety using the newly constructed stimuli in a final study, but only when pronounceability was confounded with word length. The results cast doubt on generalizability of the association between pronounceability and perceived safety and underscore the importance of treating stimulus as a random factor.

Registered Replication Report: Study 1 From Finkel, Rusbult, Kumashiro, & Hannon (2002).

Finkel, Rusbult, Kumashiro, and Hannon (2002, Study 1) demonstrated a causal link between subjective commitment to a relationship and how people responded to hypothetical betrayals of that relationship. Participants primed to think about their commitment to their partner (high commitment) reacted to the betrayals with reduced exit and neglect responses relative to those primed to think about their independence from their partner (low commitment). The priming manipulation did not affect constructive voice and loyalty responses. Although other studies have demonstrated a correlation between subjective commitment and responses to betrayal, this study provides the only experimental evidence that inducing changes to subjective commitment can causally affect forgiveness responses. This Registered Replication Report (RRR) meta-analytically combines the results of 16 new direct replications of the original study, all of which followed a standardized, vetted, and preregistered protocol. The results showed little effect of the priming manipulation on the forgiveness outcome measures, but it also did not observe an effect of priming on subjective commitment, so the manipulation did not work as it had in the original study. We discuss possible explanations for the discrepancy between the findings from this RRR and the original study.

Differences in autonomy of humans and ultrasocial insects.

The target article is built on an analogy between humans and ultrasocial insects. We argue that there are many important limitations to the analogy that make any possible inferences from the analogy questionable. We demonstrate the issue using an example of the difference between a loss of autonomy in humans and in social insects.

Is the Emotional Dog Blind to Its Choices?

Previous choice blindness studies showed that people sometimes fail to notice when their choice is changed. Subsequently, they are willing to provide reasons for the manipulated choice which is the opposite of the one they made just seconds ago. In the present study, participants first made binary judgments about the wrongness of described behaviors and then were shown an opposite answer during a second reading of some of the descriptions. Half of the participants saw the answer during the second presentation of the description and the other half saw it only after the presentation. Based on Haidt's Social intuitionist model, we hypothesized that participants in the latter group would be less likely to reconcile their intuition with the presented answer and thus they would be more likely to reject it. However, we found no difference between the groups.