Opening Pandora's Box: Peeking inside Psychology's data sharing practices, and seven recommendations for change.

Open data-sharing is a valuable practice that ought to enhance the impact, reach, and transparency of a research project. While widely advocated by many researchers and mandated by some journals and funding agencies, little is known about detailed practices across psychological science. In a pre-registered study, we show that overall, few research papers directly link to available data in many, though not all, journals. Most importantly, even where open data can be identified, the majority of these lacked completeness and reusability-conclusions that closely mirror those reported outside of Psychology. Exploring the reasons behind these findings, we offer seven specific recommendations for engineering and incentivizing improved practices, so that the potential of open data can be better realized across psychology and social science more generally.

Charting the trajectory of forgetting: Insights from a working memory period paradigm.

Working memory capacity is commonly measured in terms of its item span, and much less often in terms of its time span, or "period." The former measures how many items can be stored in working memory when carrying out episodes of concurrent processing. The latter complements this by determining the duration of processing episodes that can be tolerated while successfully storing a fixed number of items. We investigated the generality of previous evidence that working memory period varies with the distribution of longer and shorter processing episodes within a trial, and that notwithstanding such differences, a global measure of period is a reliable predictor of children's educational attainment. We describe data from 184 children, between 7 and 11 years of age, who completed variants of an operation period task with different distributions of processing episodes together with measures of scholastic attainment. Individual differences in period scores were consistent over two test sessions, and were predictive of reading and number skills. We replicated previous effects of the order of longer and shorter processing episodes, but found that they did not generalize fully to other manipulations of order. The results point to the contribution of subtle within-trial sequence configurations for working memory. We make the case for a broader view of what constrains working memory than exists in current models.

Email fraud: The search for psychological predictors of susceptibility.

Decisions that we make about email legitimacy can result in a pernicious threat to security of both individuals and organisations. Yet user response to phishing emails is far from uniform; some respond while others do not. What is the source of this diversity in decision-making? From a psychological perspective, we consider cognitive and situational influences that might explain why certain users are more susceptible than others. Alongside an email judgment task employed as a proxy for fraud susceptibility, 224 participants completed a range of cognitive tasks. In addition, we manipulated time pressure for email legitimacy judgments. We identify cognitive reflection and sensation seeking as significant, albeit modest, predictors of susceptibility. Further to this, participants asked to make quicker responses made more judgment errors. We conclude there are cognitive signatures that partially contribute to email fraud susceptibility, with implications for efforts to limit online security breaches and train secure behaviors.

Contextual support for children's recall within working memory.

Measures of working memory capacity (WMC) are extremely popular, yet we know relatively little about the specific processes that support recall. We focused on children's and adults' ability to use contextual support to access working memory representations that might otherwise not be reported. Children ( N = 186, 5-10 years) and adults ( N = 64) completed a listening span task and a delayed recall task with semantic probes or cues. Clear age-related increases in listening span were evident. All age groups benefitted from contextual support to retrieve degraded target memoranda, particularly on listening span tasks when the cues provided semantic support for processing events, in comparison to cues associated specifically with memoranda. Response latencies suggested a developing efficiency in children's use of contextual support for delayed recall correlated with listening span performance. These probe tasks support accounts of working memory that recognise reconstructive and cued search processes.

The developmental influence of primary memory capacity on working memory and academic achievement.

In this study, we investigate the development of primary memory capacity among children. Children between the ages of 5 and 8 completed 3 novel tasks (split span, interleaved lists, and a modified free-recall task) that measured primary memory by estimating the number of items in the focus of attention that could be spontaneously recalled in serial order. These tasks were calibrated against traditional measures of simple and complex span. Clear age-related changes in these primary memory estimates were observed. There were marked individual differences in primary memory capacity, but each novel measure was predictive of simple span performance. Among older children, each measure shared variance with reading and mathematics performance, whereas for younger children, the interleaved lists task was the strongest single predictor of academic ability. We argue that these novel tasks have considerable potential for the measurement of primary memory capacity and provide new, complementary ways of measuring the transient memory processes that predict academic performance. The interleaved lists task also shared features with interference control tasks, and our findings suggest that young children have a particular difficulty in resisting distraction and that variance in the ability to resist distraction is also shared with measures of educational attainment.

What can we learn about immediate memory from the development of children's free recall?

We ask the question: Which aspects of immediate memory performance improve with age? In two studies, we reexamine the widely held view that primary memory capacity estimates derived from children's immediate free recall are age invariant. This was done by assessing children's immediate free-recall accuracy while also measuring the order in which they elected to recall items (Experiment 1) and by encouraging children to begin free recall with items from towards the end of the presented list (Experiment 2). Across samples aged between 5 and 8 years we replicated the previously reported age-related changes in free-recall serial position functions when aggregated across all trials of the standard task, including an absence of age differences in the recency portion of this curve. However, we also show that this does not reflect the fact that primary memory capacity is constant across age. Instead, when we incorporate order of report information, clear age differences are evident in the recall of list-final items that are output at the start of a participant's response. In addition, the total amount that individuals recalled varied little across different types of free-recall tasks. These findings have clear implications for the use of immediate free recall as a means of providing potential indices of primary memory capacity and in the study of the development of immediate memory.

Not all numbers are equal: preferences and biases among children and adults when generating random sequences.

We investigate the number preferences of children and adults when generating random digit sequences. Previous research has shown convincingly that adults prefer smaller numbers when randomly choosing between responses 1-6. We analyze randomization choices made by both children and adults, considering a range of experimental studies and task configurations. Children - most of whom are between 8 and 11~years - show a preference for relatively large numbers when choosing numbers 1-10. Adults show a preference for small numbers with the same response set. We report a modest association between children's age and numerical bias. However, children also exhibit a small number bias with a smaller response set available, and they show a preference specifically for the numbers 1-3 across many datasets. We argue that number space demonstrates both continuities (numbers 1-3 have a distinct status) and change (a developmentally emerging bias toward the left side of representational space or lower numbers).

How do selective attentional processes contribute to maintenance and recall in children's working memory capacity?

The development of working memory capacity is considered from the perspective of the active maintenance of items in primary memory (PM) and a cue-dependent search component, secondary memory (SM). Using free recall, plus a more novel serial interleaved items task, age-related increases in PM estimates were evident in both paradigms. In addition to this, age-related improvements in attentional selectivity were observed, indexed by the recall of target and non-target information respectively. To further characterize PM, presentation modality was varied in the serial interleaved items task (auditory, visual and dual presentation). Developmental differences were found in the effectiveness of presentation formats. Older children's recall was enhanced by the combination of labeled visual items and enduring auditory information, whilst the same format was detrimental to younger children's recall of target information. The present results show how estimates of PM and SM in children relate to the development of working memory capacity, but measurement of these constructs in children is not straightforward. Data also points to age-related changes in selective attention, which in turn contributes to children's ability to process and maintain information in working memory.

Synergies between processing and memory in children's reading span.

Previous research has established the relevance of working memory for cognitive development. Yet the factors responsible for shaping performance in the complex span tasks used to assess working memory capacity are not fully understood. We report a study of reading span in 7- to 11-year-old children that addresses several contemporary theoretical issues. We demonstrate that both the timing and the accuracy of recall are affected by the presence or absence of a semantic connection between the processing requirement and the memoranda. Evidence that there can be synergies between processing and memory argues against the view that complex span simply measures the competition between these activities. We also demonstrate a consistent relationship between the rate of completing processing operations (sentence reading) and recall accuracy. At the same time, the shape and strength of this function varies with the task configuration. Taken together, these results demonstrate the potential for reconstructive influences to shape working memory performance among children.

Lucky numbers: spatial neglect affects physical, but not representational, choices in a lotto task.

Spatial neglect can be characterized by a "magnetic attraction" towards the right side of a visual stimulus array and a selection of stimuli from that hemispace. This study examined whether these distinctive characteristics in visuo-motor space are also evident in representational number space. Given that numbers are thought to be represented along a left-to-right oriented mental number line, an affinity for the spontaneous selection of larger numbers was anticipated for neglect patients. Contrary to this expectation, neglect patients (n=20) picked a similar range of numbers compared to controls (n=17) when generating a number between 1000 and 10,000 and when playing an imaginary lottery game. There was, however, a positive correlation between the biases for the imaginary lottery, number generation and a number bisection task - demonstrating that exploration asymmetries along the mental number line are consistent within individuals across tasks. Some of the patients selected smaller numbers in all of these tasks, confirming reports of dissociations between physical and numerical-representational forms of neglect. Conversely, only four (20%) of the patients could reliably be classified as demonstrating a neglect in number space. When filling out a physical lottery ticket, the neglect patients showed the expected bias towards picking numbers placed on the right-hand side of the ticket. These results demonstrate that the magnetic attraction towards the right side of mental representations is rather weak and that representational forms of neglect only occasionally co-exist with neglect in physical space.

The endurance of children's working memory: a recall time analysis.

We analyze the timing of recall as a source of information about children's performance in complex working memory tasks. A group of 8-year-olds performed a traditional operation span task in which sequence length increased across trials and an operation period task in which processing requirements were extended across trials of constant sequence length. Interword pauses were longer than are commonly found in immediate serial recall tasks yet shorter than for reading span. These pauses increased with the demands of recall, decreased across the output sequence, and were to some extent predictive of scholastic ability. Overall, timing data illustrate that recall in working memory tasks involves subtle processes of item access rather than simple readout of information from an immediate store.

Task experience and children's working memory performance: a perspective from recall timing.

Working memory is an important theoretical construct among children, and measures of its capacity predict a range of cognitive skills and abilities. Data from 9- and 11-year-old children illustrate how a chronometric analysis of recall can complement and elaborate recall accuracy in advancing our understanding of working memory. A reading span task was completed by 130 children, 75 of whom were tested on 2 occasions, with sequence length either increasing or decreasing during test administration. Substantial pauses occur during participants' recall sequences, and they represent consistent performance traits over time, while also varying with recall circumstances and task history. Recall pauses help to predict reading and number skills, alongside as well as separate from levels of recall accuracy. The task demands of working memory change as a function of task experience, with a combination of accuracy and response timing in novel task situations being the strongest predictor of cognitive attainment.

The recall of information from working memory. Insights from behavioural and chronometric perspectives.

We describe and evaluate a recall reconstruction hypothesis for working memory (WM), according to which items can be recovered from multiple memory representations. Across four experiments, participants recalled memoranda that were either integrated with or independent of the sentence content. We found consistently longer pauses accompanying the correct recall of integrated compared with independent words, supporting the argument that sentence memory could scaffold the access of target items. Integrated words were also more likely to be recalled correctly, dependent on the details of the task. Experiment 1 investigated the chronometry of spoken recall for word span and reading span, with participants completing an unfinished sentence in the latter case. Experiments 2 and 3 confirm recall time differences without using word generation requirements, while Experiment 4 used an item and order response choice paradigm with nonspoken responses. Data emphasise the value of recall timing in constraining theories of WM functioning.

When knowledge is not enough: the phenomenon of goal neglect in preschool children.

We argue that the concept of goal neglect can be fruitfully applied to understand children's potential problems in experimental tasks and real-world settings. We describe an assessment of goal neglect developed for administration to preschool children and report data on two measures derived from this task alongside the Dimensional Change Card Sort (DCCS) and an opposite color response inhibition task. The propensity to neglect initial task cues was uniquely linked to response inhibition, whereas neglect of a later cue was uniquely linked to the DCCS. Additional evidence suggests that recovery from neglect can occur and shows that goal neglect varies with the cognitive transparency of the signifying cue. Data demonstrate the importance of, and place constraints on, current theories of information regulation and foreground the notion of graded representations in working memory and executive functioning.

Working memory period: the endurance of mental representations.

Working memory span assesses the maximum number of items that can be remembered in the face of concurrent processing. Models of working memory differ on several dimensions, yet many rely exclusively on this span procedure for their evidence. Three experiments consider an alternative paradigm that attempts to capture the endurance limits for remembering a fixed number of items during concurrent processing. Eight-year-old children performed two versions of this working memory period measure--operation period and reading period. Period scores show healthy test-retest reliability and external validity for scholastic attainment, comparing well with span scores in these respects. In addition, period is highly correlated with span and shows similar effects of varying the order in which stimuli are presented. We conclude that the durability of representations is an important factor in both span and period.

Children's working-memory processes: a response-timing analysis.

Recall response durations were used to clarify processing in working-memory tasks. Experiment 1 examined children's performance in reading span, a task in which sentences were processed and the final word of each sentence was retained for subsequent recall. Experiment 2 examined the development of listening-, counting-, and digit-span task performance. Responses were much longer in the reading-and listening-span tasks than in the other span tasks, suggesting that participants in sentence-based span tasks take time to retrieve the semantic or linguistic structure as cues to recall of the sentence-final words. Response durations in working-memory tasks helped to predict academic skill and achievement, largely separate from the contributions of the memory spans themselves. Response durations thus are important in the interpretation of span task performance.

On the nature of the relationship between processing activity and item retention in children.

The concept of working memory emphasizes the interrelationship between the transient retention of information and concurrent processing activity. Three experiments address this relationship in children between 8 and 17 years of age by examining forgetting when a processing task is interpolated between presentation and recall of the memory items. Unlike previous studies, delivery of interpolated stimuli was under computer control and responses to these stimuli were timed. There were consistent effects of the duration of the interpolated task, but no effects of either its difficulty or similarity to memory material and no qualitative developmental differences in task performance. The absence of an effect of difficulty provides no support for models of working memory in which limited capacity is shared between the dual functions of processing and storage, but is compatible with an alternative "task switching" account. However, task switching did not explain developmental differences in recall. Other aspects of the results suggest that there can be interactions between processing and storage but it is argued that these cannot be straightforwardly explained in terms of either task switching or resource sharing.

Short-term memory and working memory as indices of children's cognitive skills.

In the current literature, empirical and conceptual distinctions have been drawn between a more or less passive short-term memory (STM) system and a more dynamic working memory (WM) system. Distinct tasks have been developed to measure their capacity and research has generally shown that, for adults, WM, and not STM, is a reliable predictor of general cognitive ability. However, the locus of the differences between the tasks has received little attention. We present data from children concerning measures of matrices reasoning ability, reading, and numerical skill along with forward and backward order serial recall of WM, STM, and STM with articulatory suppression tasks. As indices of children's cognitive skills, STM and WM are shown to be rather similar in terms of memory per se. Neither the opportunity for rehearsal nor task complexity provides satisfactory explanations for differences between memory tests.