Open science practices in the false memory literature.

In response to the replication crisis in psychology, the scientific community has advocated open science practices to promote transparency and reproducibility. Although existing reviews indicate inconsistent and generally low adoption of open science in psychology, a current-day, detailed analysis is lacking. Recognising the significant impact of false memory research in legal contexts, we conducted a preregistered systematic review to assess the integration of open science practices within this field, analysing 388 publications from 2015 to 2023 (including 15 replications and 3 meta-analyses). Our findings indicated a significant yet varied adoption of open science practices. Most studies (86.86%) adhered to at least one measure, with publication accessibility being the most consistently adopted practice at 73.97%. While data sharing demonstrated the most substantial growth, reaching about 75% by 2023, preregistration and analysis script sharing lagged, with 20-25% adoption in 2023. This review highlights a promising trend towards enhanced research quality, transparency, and reproducibility in false memory research. However, the inconsistent implementation of open science practices may still challenge the verification, replication, and interpretation of research findings. Our study underscores the need for a comprehensive adoption of open science to improve research reliability and validity substantially, fostering trust and credibility in psychology.

Suppression-induced forgetting: a pre-registered replication of the think/no-think paradigm.

Post-traumatic stress disorder is characterised by recurring memories of a traumatic experience despite deliberate attempts to forget (i.e., suppression). The Think/No-Think (TNT) task has been used widely in the laboratory to study suppression-induced forgetting. During the task, participants learn a series of cue-target word pairs. Subsequently, they are presented with a subset of the cue words and are instructed to think (respond items) or not think about the corresponding target (suppression items). Baseline items are not shown during this phase. Successful suppression-induced forgetting is indicated by the reduced recall of suppression compared to baseline items in recall tests using either the same or different cues than originally studied (i.e., same- and independent-probe tests, respectively). The current replication was a pre-registered collaborative effort to evaluate an online experimenter-present version of the paradigm in 150 English-speaking healthy individuals (89 females; MAge = 31.14, SDAge = 7.73). Overall, we did not replicate the suppression-induced forgetting effect (same-probe: BF01 = 7.84; d = 0.03 [95% CI: -0.13; 0.20]; independent-probe: BF01 = 5.71; d = 0.06 [95% CI: -0.12; 0.24]). These null results should be considered in light of our online implementation of the paradigm. Nevertheless, our findings call into question the robustness of suppression-induced forgetting.

The validation of online webcam-based eye-tracking: The replication of the cascade effect, the novelty preference, and the visual world paradigm.

The many benefits of online research and the recent emergence of open-source eye-tracking libraries have sparked an interest in transferring time-consuming and expensive eye-tracking studies from the lab to the web. In the current study, we validate online webcam-based eye-tracking by conceptually replicating three robust eye-tracking studies (the cascade effect, n = 134, the novelty preference, n = 45, and the visual world paradigm, n = 32) online using the participant's webcam as eye-tracker with the WebGazer.js library. We successfully replicated all three effects, although the effect sizes of all three studies shrank by 20-27%. The visual world paradigm was conducted both online and in the lab, using the same participants and a standard laboratory eye-tracker. The results showed that replication per se could not fully account for the effect size shrinkage, but that the shrinkage was also due to the use of online webcam-based eye-tracking, which is noisier. In conclusion, we argue that eye-tracking studies with relatively large effects that do not require extremely high precision (e.g., studies with four or fewer large regions of interest) can be done online using the participant's webcam. We also make recommendations for how the quality of online webcam-based eye-tracking could be improved.

Hide or Seek? Physiological Responses Reflect Both the Decision and the Attempt to Conceal Information.

The process of information concealment is more relevant than ever in this day and age. Using a modified concealed-information test (CIT), we aimed to unmask this process by investigating both the decision and the attempt to conceal information in 38 students. The attempt to conceal (vs. reveal) information induced a differential physiological response pattern within subjects-whereas skin conductance increased in both conditions, respiration and heart rate were suppressed only in the conceal condition-confirming the idea that these measures reflect different underlying mechanisms. The decision to conceal (vs. reveal) information induced enhanced anticipatory skin conductance responses. To our knowledge, this is the first study that observed such anticipatory responses in an information-concealment paradigm. Together, these findings imply that our physiological responses reflect, to some degree, both the decision and the attempt to conceal information. In addition to strengthening CIT theory, this knowledge sheds novel light on anticipatory responding in decision making.

Current status of forensic lie detection with the comparison question technique: An update of the 2003 National Academy of Sciences report on polygraph testing.

Fifteen years have elapsed since a report was released by the National Academy of Sciences (NAS) on the scientific status of polygraph testing. The NAS report concluded that the scientific basis of the comparison question technique (CQT) was weak, the extant research was of low quality, the polygraph profession's claims for the high accuracy of the CQT were unfounded, and, although the CQT has greater than chance accuracy, its error rate is unknown. Polygraph proponents argue that current research indicates that the CQT has 90% or better accuracy, the National Research Council of the National Academy of Sciences' (2003) analysis supports this accuracy claim, and the CQT qualifies as legally admissible scientific evidence. We review the scientific literature that has appeared since the appearance of the NAS publication, including a new method for estimating polygraph accuracy. We show that the NAS report has been misrepresented and misinterpreted by those who support use of the CQT in forensic settings. We conclude that the quality of research has changed little in the years elapsing since the release of the NAS report, and that the report's landmark conclusions still stand. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

The effect of negative valence on false memory formation in the Deese-Roediger-McDermott paradigm: A preregistered meta-analysis and preregistered replication.

Participants in the Deese-Roediger-McDermott (DRM) paradigm learn lists of words (e.g., bed, tired) associated with a nonpresented lure (i.e., sleep). In subsequent memory tests, individuals tend to report the nonlearned lures, that is, exhibiting false memories. Priorly, the DRM task has been criticized for not capturing the aversive nature of (clinically and forensically relevant) real-life memories. To obtain a robust estimate of the influence of negative versus neutral word lists on the DRM effect, we conducted both a preregistered meta-analysis (krecall = 49, nrecall = 2,209, krecognition = 75, nrecognition = 3,008, kresponsebias = 31, nresponsebias = 1,128) and replication (nfinal = 278) predicting increased false memories for negative valence in recall and recognition. For recall, we found significant frequentist evidence in the meta-analysis for a reversed valence effect (d = -0.18, i.e., reduced false memories for negative content vs. neutral), whereas the replication displayed null results (d = 0.03). For recognition, both the meta-analysis (d = 0.23) and replication (d = 0.35) showed that negative valence (vs. neutral) increased false memories. However, this effect may be confounded by shifts in response tendencies as controlling for response bias nullified the valence effect in our meta-analysis (dmeta = 0.05), and we found evidence for differential response bias in our replication (dreplica = 0.39). Hence, the effect of valence on false memory reports in the DRM may not represent a systematic difference in emotional information but instead depend on how memory is tested, and be partly attributable to differential response tendencies. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

A new theoretical perspective on concealed information detection.

The concealed information test (CIT) was designed to detect concealed knowledge. It does so by measuring differential physiological and behavioral responses to concealed, compared to control, items - i.e., the CIT effect. Although the CIT has gained extensive empirical support in laboratory studies, scientific validity requires also a theoretical understanding of the method's underlying mechanisms. In this article, we present a new theoretical perspective. Specifically, we elaborate and clarify several features of Orienting Response (OR) theory, which has been the dominant theory in this domain. Importantly, we suggest for the first time that the voluntary (rather than the involuntary) OR modulates the CIT effect. Second, we argue that motivational-emotional accounts of the CIT effect are consistent with OR theory and cannot be considered as alternative approaches. Finally, we discuss some more recent developments which highlight the idea that different physiological measures reflect different underlying mechanisms - an idea dubbed as response fractionation.

The promise of eye-tracking in the detection of concealed memories.

There is a need for validated, theory-driven methods for memory detection. We review how physiological, neurophysiological, and oculomotor measures can be utilized to reveal concealed memories. Recent advances and future directions are discussed in light of the potential of eye-tracking to improve detection efficiency and resolve problems in real-world settings.

The role of response conflict in concealed information detection with reaction times.

The concealed information test (CIT) presents various probe (familiar) items amidst irrelevant (unfamiliar) items. When the probe items appear, reaction time (RT) slows down. This RT-CIT effect has been accounted for by a conflict resulting from the need to deny familiarity of the familiar probes. The present pre-registered study (n = 292) examined whether response conflict is sufficient to account for the RT-CIT effect, using city and name items. Specifically, we compared the common conflict condition, where the response buttons emphasized familiarity of CIT items ("unfamiliar" versus "familiar"), to a novel no conflict condition, where the buttons emphasized categorical membership ("city" versus "name"). In line with our expectations, the RT-CIT effect was substantially stronger in the conflict condition; yet, it remained significant even in the no conflict condition. This implies a critical role for response conflict, but also suggests that other mechanisms (e.g. orientation to significant stimuli) may contribute to the RT-CIT effect.

Countering information leakage in the Concealed Information Test: The effects of item detailedness.

Concealed Information Tests (CIT) are administered to verify whether suspects recognize certain features from a crime. Whenever it is presumed that innocent suspects were contaminated with critical information (e.g., the perpetrator had a knife), the examiner may ask more detailed questions (e.g., specific types of knives) to prevent false positives. However, this may increase the number of false negatives if the true perpetrator fails to discern specific details from its plausible irrelevant controls, or because detailed crime-scene information may be forgotten. We examined whether presenting items at the exemplar level protects against contamination, and whether it compromises the sensitivity in a physiological CIT. Participants (N = 142) planned a mock-robbery, with critical items encoded either at the category or at the exemplar level. The CIT was administered immediately or after a 1-week-delay, with questions phrased at the categorical or exemplar level. There were no effects of time delay. Results revealed that when item detailedness was congruent at encoding and testing, the SCR, HR, and RLL showed larger differential responses, as compared with incongruent conditions. Participants contaminated with crime knowledge at the categorical level did not show a CIT-effect for crime details at the exemplar level, suggesting detailed questions may counter the leakage problem. Asking questions at the exemplar level did not reduce the CIT detection efficiency as compared to asking questions at the categorical level. The importance of congruency between encoding and testing provides examiners with a challenge, as it is difficult to estimate how details are naturally encoded.

Keep an eye on your belongings: Gaze dynamics toward familiar and unfamiliar objects.

Through a series of studies, we investigate how people direct gaze toward familiar and unfamiliar objects. When an observer tries to encode objects, gaze is first directed preferentially to the familiar object followed by a later prioritization of the unfamiliar ones. We demonstrate that the initial preference reflects prioritization of personally significant information and could be volitionally controlled. The latter prioritization of the unfamiliar objects is determined by the immediate goals due to the task and is less controllable. These findings imply that the mechanism that guides gaze is flexible, affected by both long-term significance and short-term goals and could be only partially controlled. This study has also imperative practical implications for detecting concealed information using eye tracking. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Brain-based concealed memory detection is driven mainly by orientation to salient items.

In the pursuit of new methods for concealed memory detection, event-related potential components (ERP) have been placed at the forefront of research. No method, however, is scientifically complete without a theory and the present study therefore aimed to unravel the cognitive processes underlying these ERPs (i.e., orienting and arousal inhibition). This was accomplished by using a Concealed Information Test (CIT) in which participants were once motivated to conceal and once motivated to reveal their identity. The results showed a similarly strong P3 CIT effect in the two motivational conditions, which was enhanced for high salience compared to low salience identity items. Similar results were observed when using a multivariate machine-learning algorithm - suggesting that brain-based concealed memory detection is driven mainly by orientation to salient stimuli, rather than by arousal inhibition. In addition, the algorithm, trained and tested on the ERPs of different identity items, achieved detection rates exceeding those achieved by the P3. This implies that CIT researchers and practitioners could potentially rely on the entire ERP waveform instead of a-priori selecting separate components. Together these results enrich current understanding of the mechanisms underlying neurophysiological responding to concealed information and pave the way for novel and powerful algorithms which could be used in real-life forensic investigations.

Is the CIT susceptible to misleading information? A constructive replication.

The Concealed Information Test (CIT) utilizes psychophysiological measures to detect crime-related knowledge in a suspect's memory. In other words, it can discriminate between knowledgeable (guilty) and unknowledgeable (innocent) suspects. The majority of CIT research is however conducted in controlled laboratory settings, which are more resistant to external influences than realistic forensic settings. Such influences include retroactive memory interferences which may threaten the validity of the CIT. One notable example is the misinformation effect - retroactive memory distortions caused by exposure to misleading information regarding a past event. The current study is a constructive replication of Volz et al. (J Forensic Sci 2017;63:1419) examining the effects of misleading information on the CIT. Participants underwent a three-stage experiment including a mock crime, exposure to misleading information, and a CIT. Results show that when misleading information was presented, explicit memory of the mock crime was reduced, but the physiological responses to the critical CIT items were only partially attenuated. This could suggest that the detection of crime-relevant information, using skin conductance and respiration measures, might be possible even when suspects are exposed to misleading information.

Memory-Based Deception Detection: Extending the Cognitive Signature of Lying From Instructed to Self-Initiated Cheating.

From a cognitive perspective, lying can be regarded as a complex cognitive process requiring the interplay of several executive functions. Meta-analytic research on 114 studies encompassing 3,307 participants (Suchotzki, Verschuere, Van Bockstaele, Ben-Shakhar, & Crombez, 2017) suggests that computerized paradigms can reliably assess the cognitive burden of lying, with large reaction time differences between lying and truth telling. These studies, however, lack a key ingredient of real-life deception, namely self-initiated behavior. Research participants have typically been instructed to commit a mock crime and conceal critical information, whereas in real life, people freely choose whether or not to engage in antisocial behavior. In this study, participants (n = 433) engaged in a trivia quiz and were provided with a monetary incentive for high accuracy performance. Participants were randomly allocated to either a condition where they were instructed to cheat on the quiz (mimicking the typical laboratory set-up) or to a condition in which they were provided with the opportunity to cheat, yet without explicit instructions to do so. Assessments of their response times in a subsequent Concealed Information Test (CIT) revealed that both instructed cheaters (n = 107) and self-initiated cheaters (n = 142) showed the expected RT-slowing for concealed information. The data indicate that the cognitive signature of lying is not restricted to explicitly instructed cheating, but it can also be observed for self-initiated cheating. These findings are highly encouraging from an ecological validity perspective.

Distinguishing true from false confessions using physiological patterns of concealed information recognition - A proof of concept study.

Wrongful conviction cases indicate that not all confessors are guilty. However, there is currently no validated method to assess the veracity of confessions. In this preregistered study, we evaluate whether a new application of the Concealed Information Test (CIT) is a potentially valid method to make a distinction between true and false admissions of guilt. Eighty-three participants completed problem-solving tasks, individually and in pairs. Unbeknownst to the participants, their team-member was a confederate, tempting the participant to break the experimental rules by assisting during an individual assignment. Irrespective of actual rule-breaking behavior, all participants were accused of cheating and interrogated. True confessors but not false confessors showed recognition of answers obtained by cheating in the individual task, as evidenced by larger physiological responses to the correct than to plausible but incorrect answers. These findings encourage further investigation on the use of memory detection to discriminate true from false confessions.

Countering countermeasures in the concealed information test using covert respiration measures.

The effects of physical and mental countermeasures on the accuracy of the concealed information test (CIT) were examined in a mock crime experiment with 64 participants. To combat countermeasures, two covert respiration measures, hidden in the seat and back of the examination chair, were used in addition to the standard physiological measures (SCR, FPWL, RLL). Some guilty participants were trained to use either physical or mental countermeasures and apply them to distort the outcomes of the CIT. In the second phase of the experiment participants were detached from the standard polygraph devices and examined solely with the two covert measures. Results indicated that physical countermeasures lowered SCR accuracy but had a relatively small effect on the other standard measures. On the other hand, SCR was relatively resistant to mental countermeasures. Both covert measures were resistant to physical countermeasures in the polygraph phase. When the standard devices were removed, the covert seat measure was effective in the no countermeasure and in the mental countermeasure conditions but not when physical countermeasures were applied. The back measure was entirely ineffective.

What is it that color determinants determine? The relation between the rorschach inkblot method and cognitive object-recognition processes.

We sought to demonstrate a relation between the Determinants in the Rorschach Inkblot Method (Rorschach, 1921) and fundamental properties of the participant's cognitive (visual) system by examining whether the report about Color Determinants is related to basic cognitive processes concerned with color of visual objects. In Experiment 1, we established an object-naming task that is sensitive to the objects' color. Participants were strongly influenced by the object's color, responding fastest when objects appeared in their typical color and slowest when the object's color was atypical. In Experiment 2, we examined the relationship between the Color Determinants in the Rorschach Inkblot Method and the magnitude of the color effect in the object-naming task of Experiment 1. It was found that the effect of color in the object-naming task was correlated with the type of color responses in the Rorschach Inkblot Method. The results support an "early" cognitive account of the Determinants. We discuss implications concerning the theory of the Rorschach and the relation between emotion, personality, and cognition.

The ethical significance of diagnostic test results in psychology practice.

"Psychologists base the opinions contained in their recommendations, reports and diagnostic or evaluative statements including forensic testimony on information and techniques sufficient to substantiate their findings". Do expert psychodiagnosticians rely in their professional final reports on the materials and raw data obtained from test materials? How ethical are they in their professional performances? In order to answer this question, expert clinical psychologists were given batteries of psychodiagnostic tests, accompanied by one of two different types of background information, suggesting either a Borderline Personality Disorder, or a Paranoid Personality Disorder. This background information was a full and strongly suggestive story in one experiment, and a mere hypothesis in another. All conditions manifested a confirmation bias: the psychodiagnostic reports were profoundly biased by the background suggestions. The present paper focuses on a content analysis of the reports, and shows that the experts referred very little if at all to the psychodiagnostic materials they received. They were found less professional and as a result- less ethical. The ethical relevance of these findings to the teaching and training of professional psychodiagnosticians is discussed, with an emphasis on the importance of teaching students and interns in clinical psychology to base their diagnostic reports on the test data.

Detecting concealed familiarity using eye movements: the role of task demands.

BACKGROUND: What can theories regarding memory-related gaze preference contribute to the field of deception detection? While abundant research has examined the ability to detect concealed information through physiological responses, only recently has the scientific community started to explore how eye tracking can be utilized for that purpose. However, previous attempts to detect deception through eye movements have led to relatively low detection ability in comparison to physiological measures. In the current study, we demonstrate that the modulation of gaze behavior by familiarity, changes considerably when participants perform a visual detection task in comparison to a short-term memory task (that was used in a previous study). Thus, we highlight the importance of theory-based selection of task demands for improving the ability to detect concealed information using eye-movement measures. RESULTS: During visual exploration of four faces (some familiar and some unfamiliar) gaze was allocated preferably on familiar faces, manifested by more fixations. However, this preference tendency vanished once participants were instructed to convey countermeasures and conceal their familiarity by deploying gaze equally to all faces. This gaze behavior during the visual detection task differed significantly from the one observed during a short-term memory task used in a previous study in which a preference towards unfamiliar faces was evident even when countermeasures were applied. CONCLUSIONS: Different tasks elicit different patterns of gaze behavior towards familiar and unfamiliar faces. Moreover, the ability to voluntarily control gaze behavior is tightly related to task demands. Adequate ability to control gaze was observed in the current visual detection task when memorizing the faces was not required for a successful accomplishment of the task. Thus, applied settings would benefit from a short-term memory task which is much more robust to countermeasure efforts. Beyond shedding light on theories of gaze preference, these findings provide a backbone for future research in the field of deception detection via eye movements.

It's a match!? Appropriate item selection in the Concealed Information Test.

BACKGROUND: While the Concealed Information Test (CIT) can determine whether examinees recognize critical details, it does not clarify the origin of the memory. Hence, when unknowledgeable suspects are contaminated with crime information through media channels or investigative interviews, the validity of the CIT can be compromised (i.e. false-positive outcomes). Yet, when the information was disclosed solely at the category level (e.g. the perpetrator escaped in a car), presenting specific items at the exemplar level (e.g. Citroën, Opel, or Volkswagen) might preclude this problem. However, diminished recollection for exemplar-level details could attenuate the CIT effect for knowledgeable suspects, thereby leading to false negatives. The appropriate item level for memory detection to reach an optimal balance between sensitivity and specificity remains elusive. As encoding, retention, and retrieval of information may influence memory performance and thereby memory detection, the current study investigated the validity of the CIT on both categorical and exemplar levels. RESULTS: Participants planned a mock robbery (n = 165), with information encoded at the category (e.g. car) or exemplar (e.g. Citroën) level. They were tested immediately or after a one-week-delay, with a response time-based CIT consisting of questions at the categorical or exemplar level. An interaction was found between encoding and testing, such that CIT validity based on reaction time was higher for "matching" (e.g. exemplar-exemplar) than for "mismatching" (e.g. exemplar-categorical) items, while immediate versus one week delayed testing did not affect the outcome. CONCLUSION: Critically, this indicates that what constitutes a good CIT item depends on the way the information was encoded. This provides a challenge for CIT examiners when selecting appropriate items.