pyWitness 1.0: A python eyewitness identification analysis toolkit.

pyWitness is a python toolkit for recognition memory experiments, with a focus on eyewitness identification (ID) data analysis and model fitting. The current practice is for researchers to use different statistical packages to analyze a single dataset. pyWitness streamlines the process. In addition to conducting key data analyses (e.g., receiver operating characteristic analysis, confidence accuracy characteristic analysis), statistical comparisons, signal-detection-based model fits, simulated data generation, and power analyses are also possible. We describe the package implementation and provide detailed instructions and tutorials with datasets so that users can follow. There is also an online manual that is regularly updated. We developed pyWitness to be user-friendly, reduce human interaction with pre-processing and processing of data and model fits, and produce publication-ready plots. All pyWitness features align with open science practices, such that the algorithms, fits, and methods are reproducible and documented. While pyWitness is a python toolkit, it can also be used from R for users more accustomed to this environment.

Eyewitness memory is reliable, but the criminal justice system is not.

The reliability of any type of forensic evidence (e.g., forensic DNA) is assessed by testing its information value when it is not contaminated and is properly tested. Assessing the reliability of forensic memory evidence should be no exception to that rule. Unfortunately, testing a witness's memory irretrievably contaminates it. Thus, only the first (properly conducted) test is relevant to the question of whether eyewitness memory is reliable. With few exceptions, the results of studies conducted in the lab and in the real world show that confidence is highly predictive of accuracy on the first test, and high-confidence often implies high accuracy. The fact that many eyewitnesses are known to have made high-confidence misidentifications in the courtroom has cemented the almost universal impression that eyewitness memory is unreliable. However, it is the criminal justice system that is guilty of unwittingly using contaminated memory evidence (relying on the last memory test, in court) in conjunction with an improper testing procedure (namely, a courtroom showup) to win convictions of the innocent. That mistake should no longer be blamed on the unreliability of eyewitness memory.

Doing right by the eyewitness evidence: a response to Berkowitz et al.

Berkowitz et al. (Berkowitz, S. R., Garrett, B. L., Fenn, K. M., & Loftus, E. F. (2020). Convicting with confidence? Why we should not over-rely on eyewitness confidence. Memory. https://doi.org/10.1080/09658211.2020.1849308) attribute to us the claim that "confidence trumps all", and the few out-of-context quotations they selected can certainly be used to create that false impression. However, it is easily disproved, and we do so here. The notion that "confidence trumps all" is the mistake that the jurors made in the DNA exoneration cases, not a position that we have ever advocated.

Estimating the reliability of eyewitness identifications from police lineups.

Laboratory-based mock crime studies have often been interpreted to mean that (i) eyewitness confidence in an identification made from a lineup is a weak indicator of accuracy and (ii) sequential lineups are diagnostically superior to traditional simultaneous lineups. Largely as a result, juries are increasingly encouraged to disregard eyewitness confidence, and up to 30% of law enforcement agencies in the United States have adopted the sequential procedure. We conducted a field study of actual eyewitnesses who were assigned to simultaneous or sequential photo lineups in the Houston Police Department over a 1-y period. Identifications were made using a three-point confidence scale, and a signal detection model was used to analyze and interpret the results. Our findings suggest that (i) confidence in an eyewitness identification from a fair lineup is a highly reliable indicator of accuracy and (ii) if there is any difference in diagnostic accuracy between the two lineup formats, it likely favors the simultaneous procedure.

Models of lineup memory.

Face recognition memory is often tested by the police using a photo lineup, which consists of one suspect, who is either innocent or guilty, and five or more physically similar fillers, all of whom are known to be innocent. For many years, lineups were investigated in lab studies without guidance from standard models of recognition memory. More recently, signal detection theory has been used to conceptualize lineup memory and to motivate receiver operating characteristic (ROC) analysis of lineup performance. Here, we describe three competing signal-detection models of lineup memory, derive their likelihood functions, and fit them to empirical ROC data. We also introduce the notion that memory signals generated by the faces in a lineup are likely to be correlated because, by design, those faces share features. The models we investigate differ in their predictions about the effect that correlated memory signals should have on the ability to discriminate innocent from guilty suspects. A popular compound signal detection model known as the Integration model predicts that correlated memory signals should impair discriminability. Empirically, this model performed so poorly that, going forward, it should probably be abandoned. The best-fitting model incorporates a principle known as "ensemble coding," which predicts that correlated memory signals should enhance discriminability. The ensemble model aligns with a previously proposed theory of eyewitness identification according to which the simultaneous presentation of faces in a lineup enhances discriminability compared to when faces are presented in isolation because it permits eyewitnesses to detect and discount non-diagnostic facial features.

Increased False-Memory Susceptibility After Mindfulness Meditation.

The effect of mindfulness meditation on false-memory susceptibility was examined in three experiments. Because mindfulness meditation encourages judgment-free thoughts and feelings, we predicted that participants in the mindfulness condition would be especially likely to form false memories. In two experiments, participants were randomly assigned to either a mindfulness induction, in which they were instructed to focus attention on their breathing, or a mind-wandering induction, in which they were instructed to think about whatever came to mind. The overall number of words from the Deese-Roediger-McDermott paradigm that were correctly recalled did not differ between conditions. However, participants in the mindfulness condition were significantly more likely to report critical nonstudied items than participants in the control condition. In a third experiment, which tested recognition and used a reality-monitoring paradigm, participants had reduced reality-monitoring accuracy after completing the mindfulness induction. These results demonstrate a potential unintended consequence of mindfulness meditation in which memories become less reliable.

Specificity of children's arithmetic learning.

Among adults, arithmetic training-transfer studies have documented a high degree of learning specificity. Provided that there is a delay of at least 1day between training and testing, performance gains do not transfer to untrained problems, nor do they transfer to complement operation-inverted problems (e.g., gains for 4+7=__ do not transfer to the complement subtraction problem, 11-4=__, or vice versa). Here we demonstrate the same degree of learning specificity among 6- to 11-year-old children. These results appear to rule out, for the current training paradigm, operation-level procedural learning as well as any variant of complement problem mediation that would predict transfer. Results are consistent with either or both of two types of learning: (a) item-level procedural learning and (b) a shift to memory-based performance as predicted by the elemental elements model. These results suggest a developmental pattern such that specificity of learning among children is similar to that among adults. Educational implications are noted.

Application of artificial intelligence to eyewitness identification.

Artificial intelligence is already all around us, and its usage will only increase. Knowing its capabilities is critical. A facial recognition system (FRS) is a tool for law enforcement during suspect searches and when presenting photos to eyewitnesses for identification. However, there are no comparisons between eyewitness and FRS accuracy using video, so it is unknown whether FRS face matches are more accurate than eyewitness memory when identifying a perpetrator. Ours is the first application of artificial intelligence to an eyewitness experience, using a comparative psychology approach. As a first step to test system accuracy relative to eyewitness accuracy, participants and an open-source FRS (FaceNet) attempted perpetrator identification/match from lineup photos (target-present, target-absent) after exposure to real crime videos with varied clarity and perpetrator race. FRS used video probe images of each perpetrator to achieve similarity ratings for each corresponding lineup member. Using receiver operating characteristic analysis to measure discriminability, FRS performance was superior to eyewitness performance, regardless of video clarity or perpetrator race. Video clarity impacted participant performance, with the unclear videos yielding lower performance than the clear videos. Using confidence-accuracy characteristic analysis to measure reliability (i.e., the likelihood the identified suspect is the actual perpetrator), when the FRS identified faces with the highest similarity values, they were accurate. The results suggest FaceNet, or similarly performing systems, may supplement eyewitness memory for suspect searches and subsequent lineup construction and knowing the system's strengths and weaknesses is critical.

Major memory for microblogs.

Online social networking is vastly popular and permits its members to post their thoughts as microblogs, an opportunity that people exploit, on Facebook alone, over 30 million times an hour. Such trivial ephemera, one might think, should vanish quickly from memory; conversely, they may comprise the sort of information that our memories are tuned to recognize, if that which we readily generate, we also readily store. In the first two experiments, participants' memory for Facebook posts was found to be strikingly stronger than their memory for human faces or sentences from books-a magnitude comparable to the difference in memory strength between amnesics and healthy controls. The second experiment suggested that this difference is not due to Facebook posts spontaneously generating social elaboration, because memory for posts is enhanced as much by adding social elaboration as is memory for book sentences. Our final experiment, using headlines, sentences, and reader comments from articles, suggested that the remarkable memory for microblogs is also not due to their completeness or simply their topic, but may be a more general phenomenon of their being the largely spontaneous and natural emanations of the human mind.

Illustrations of interactions needed when investigating sleep using a type of AM-PM PM-AM design.

Sleep has long been thought of and promoted to be beneficial for memory. Some claims that sleep aids memory have been made in the absence of a critical interaction. This condition is necessary when using a commonly-used experimental design (a type of AM-PM PM-AM design). We propose that a sleep effect exists only if there is an interaction between groups (experimental and time-of-day controls) and the time of test or study (morning and evening). We show different patterns of results that would and would not support a sleep effect with empirical and model-generated data from recognition memory experiments and hypothetical data. While we use these data to make our point, our suggestions apply to any memory and non-memory-related investigation (e.g., emotional memory, false memory susceptibility, language learning, problem-solving). Testing for and finding the proper interaction will add to the evidence that sleep boosts performance.

Lineup identification in young and older witnesses: does describing the criminal help or hinder?

The world population is getting older and, as a result, the number of older victims of crime is expected to increase. It is therefore essential to understand how ageing affects eyewitness identification, so procedures can be developed that enable victims of crime of all ages to provide evidence as accurately and reliably as possible. In criminal investigations, witnesses often provide a description of the perpetrator of the crime before later making an identification. While describing the perpetrator prior to making a lineup identification can have a detrimental effect on identification in younger adults, referred to as verbal overshadowing, it is unclear whether older adults are affected in the same way. Our study compared lineup identification of a group of young adults and a group of older adults using the procedure that has consistently revealed verbal overshadowing in young adults. Participants watched a video of a mock crime. Following a 20-min filled delay, they either described the perpetrator or completed a control task. Immediately afterwards, they identified the perpetrator from a lineup, or indicated that the perpetrator was not present, and rated their confidence. We found that describing the perpetrator decreased subsequent correct identification of the perpetrator in both young and older adults. This effect of verbal overshadowing was not explained by a change in discrimination but was consistent with participants adopting a more conservative criterion. Confidence and response time were both found to predict identification accuracy for young and older groups, particularly in the control condition.

Eyewitness Identification Is a Visual Search Task.

The simultaneous six-pack photo lineup is a standard eyewitness identification procedure, consisting of one police suspect plus five physically similar fillers. The photo lineup is either a target-present array (the suspect is guilty) or a target-absent array (the suspect is innocent). The eyewitness is asked to search the six photos in the array with respect to a target template stored in memory (namely, the memory of the perpetrator's face). If the witness determines that the perpetrator is in fact in the lineup (detection), then the next step is to specify the position of the perpetrator's face in the lineup (localization). The witness may also determine that the perpetrator is not present and reject the lineup. In other words, a police lineup is a detection-plus-localization visual search task. Signal detection concepts that have long guided thinking about visual search have recently had a significant impact on our understanding of police lineups.

The effect of lineup size on eyewitness identification.

Eyewitness identification via lineup procedures is an important and widely used source of evidence in criminal cases. However, the scientific literature provides inconsistent guidance on a very basic feature of lineup procedure: lineup size. In two experiments, we examined whether the number of fillers affects diagnostic accuracy in a lineup, as assessed with receiver-operating characteristic (ROC) analysis. Showups (identification procedures with one face) led to lower discriminability than simultaneous lineups. However, in neither experiment did the number of fillers in a lineup affect discriminability. We also evaluated competing models of decision-making from lineups. This analysis indicated that the standard Independent Observations (IO) model, which assumes a decision rule based on the comparison of memory strength signals generated by each face in a lineup, is incapable of reproducing the lower level of performance evident in showups. We could not adjudicate between the Ensemble model, which assumes a decision rule based on the comparison of the strength of each face with the mean strength across the lineup, and a newly introduced Dependent Observations model, which adopts the same decision rule as the IO model, but with correlated signals across faces. We draw lessons for users of lineup procedures and for basic research on eyewitness decision making. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Measuring recollection and familiarity in the medial temporal lobe.

Many recent studies have investigated how the structures of the medial temporal lobe (MTL) support recollection and familiarity, which are two processes widely thought to support recognition memory. The behavioral methods that are used to isolate recollection and familiarity in neuroimaging and lesion studies typically assume that recollection is a categorical process and not a continuous process. A categorical process is one that either occurs or does not occur for a particular test item (yielding high confidence and high accuracy when it does occur), whereas a continuous process is one that comes in degrees (yielding varying degrees of confidence and accuracy). Studies suggesting that the hippocampus selectively supports the recollection process (such as those that use the Remember/Know procedure or rely on Receiver Operating Characteristic analysis) generally depend on the categorical view of recollection, but much recent evidence suggests that recollection is a continuous process. If recollection is a continuous process (i.e., if recollection comes in degrees), then evidence that has been taken to mean that the hippocampus selectively supports recollection is also compatible with the idea that the hippocampus supports both recollection and familiarity. We suggest that an alternative method can be used to effectively investigate recollection and familiarity in the MTL, one that is valid whether recollection is a categorical or a continuous process.

A comparison of two brief screening measures of cognitive impairment in Huntington's disease.

The goal of this study was to explore whether the Montreal Cognitive Assessment (MoCA), a new screening instrument, would be more sensitive to mild to moderate cognitive impairment in Huntington's disease (HD) than an established screening measure, the Mini Mental State Exam (MMSE). Our reasoning for this query is that the MoCA includes a broader range of test items and an additional assessment of executive functioning and attention compared with the MMSE. Using the receiver operating characteristic (ROC) analysis to examine performance of HD and control groups on both tests on overall scores and scores from various subdomains (i.e., visuospatial abilities) revealed that the MoCA achieved higher sensitivity without sacrificing specificity in many domains relative to the MMSE.

Recollection is a continuous process: implications for dual-process theories of recognition memory.

Dual-process theory, which holds that recognition decisions can be based on recollection or familiarity, has long seemed incompatible with signal detection theory, which holds that recognition decisions are based on a singular, continuous memory-strength variable. Formal dual-process models typically regard familiarity as a continuous process (i.e., familiarity comes in degrees), but they construe recollection as a categorical process (i.e., recollection either occurs or does not occur). A continuous process is characterized by a graded relationship between confidence and accuracy, whereas a categorical process is characterized by a binary relationship such that high confidence is associated with high accuracy but all lower degrees of confidence are associated with chance accuracy. Using a source-memory procedure, we found that the relationship between confidence and source-recollection accuracy was graded. Because recollection, like familiarity, is a continuous process, dual-process theory is more compatible with signal detection theory than previously thought.

Designing police lineups to maximize memory performance.

How can lineups be designed to elicit the best achievable memory performance? One step toward that goal is to compare lineup procedures. In a recent comparison of U.S. and U.K. lineup procedures, discriminability and reliability was better when memory was tested using the U.S. procedure. However, because there are so many differences between the procedures, it is unclear what explains this superior performance. The main goal of the current research is, therefore, to systematically isolate the differences between the U.S. and U.K. lineups to determine their effects on discriminability and reliability. In 5 experiments, we compared (a) presentation format: simultaneous versus sequential; (b) stimulus format: photos versus videos; (c) number of views: 1-lap versus 2-lap versus choice in both video and photo lineups; and (d) lineup size: 6- versus 9-lineup members. Most of the comparisons did not show appreciable differences, but one comparison did: simultaneous presentation yielded better discriminability than sequential presentation. If the results replicate, then policymakers should recommend using a simultaneous lineup procedure. Moreover, consistent with previous research, identifications made with high confidence were higher in reliability than identifications made with low confidence. Thus, official lineup protocols should require collecting confidence because of the diagnostic value added. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Theoretical vs. empirical discriminability: the application of ROC methods to eyewitness identification.

Receiver operating characteristic (ROC) analysis was introduced to the field of eyewitness identification 5 years ago. Since that time, it has been both influential and controversial, and the debate has raised an issue about measuring discriminability that is rarely considered. The issue concerns the distinction between empirical discriminability (measured by area under the ROC curve) vs. underlying/theoretical discriminability (measured by d' or variants of it). Under most circumstances, the two measures will agree about a difference between two conditions in terms of discriminability. However, it is possible for them to disagree, and that fact can lead to confusion about which condition actually yields higher discriminability. For example, if the two conditions have implications for real-world practice (e.g., a comparison of competing lineup formats), should a policymaker rely on the area-under-the-curve measure or the theory-based measure? Here, we illustrate the fact that a given empirical ROC yields as many underlying discriminability measures as there are theories that one is willing to take seriously. No matter which theory is correct, for practical purposes, the singular area-under-the-curve measure best identifies the diagnostically superior procedure. For that reason, area under the ROC curve informs policy in a way that underlying theoretical discriminability never can. At the same time, theoretical measures of discriminability are equally important, but for a different reason. Without an adequate theoretical understanding of the relevant task, the field will be in no position to enhance empirical discriminability.

The effects of verbal descriptions on performance in lineups and showups.

Verbally describing a face has been found to impair subsequent recognition of that face from a photo lineup, a phenomenon known as the verbal overshadowing effect (Schooler & Engstler-Schooler, 1990). Recently, a large direct replication study successfully reproduced that original finding (Alogna et al., 2014). However, in both the original study and the replication studies, memory was tested using only target-present lineups (i.e., lineups containing the previously seen target face), making it possible to compute the correct identification rate (correct ID rate; i.e., the hit rate) but not the false identification rate (false ID rate; i.e., the false alarm rate). Thus, the lower correct ID rate for the verbal condition could reflect either reduced discriminability or a conservative criterion shift relative to the control condition. In four verbal overshadowing experiments reported here, we measured both correct ID rates and false ID rates using photo lineups (Experiments 1 and 2) or single-photo showups (Experiments 3 and 4). The experimental manipulation (verbally describing the face or not) occurred either immediately after encoding (Experiments 1 and 3) or 20-min after encoding (Experiments 2 and 4). In the immediate condition, discriminability did not differ between groups, but in the delayed condition, discriminability was lower in the verbal description group (i.e., a verbal overshadowing effect was observed). A fifth experiment found that the effect of the immediate-versus-delayed manipulation may be attributable to a change in the content of verbal descriptions, with the ratio of diagnostic to generic facial features in the descriptions decreasing as delay increases. (PsycINFO Database Record