Mind-wandering, how do I measure thee with probes? Let me count the ways.

In the past decade, a new field has formed to investigate the concept of mind-wandering, or task-unrelated thought. The state of mind-wandering is typically contrasted with being on-task, or paying attention to the task at hand, and is related to decrements in performance on cognitive tasks. The most widely used method for collecting mind-wandering data-the probe-caught method-involves stopping participants during a task and asking them where their attention is directed. In this review, 145 studies from 105 articles published between 2005 and 2015 were classified according to the framing and wording of the thought probe and response options. Five distinct methodologies were identified: neutral (in which counterbalancing was used to equally emphasize on-task and off-task states), dichotomous (say "yes" or "no" to one thought state), dichotomous (choose between two thought states), categorical, and scale. The review identifies at least 69 different methodological variants, catalogues the verbatim probes and response options used in each study, and suggests important considerations for future empirical work.

Adapting to test structure: letting testing teach what to learn.

We propose that we encode and store information as a function of the particular ways we have used similar information in the past. More specifically, we contend that the experience of retrieval can serve as a powerful cue to the most effective ways to encode similar information in comparable future learning episodes. To explore these ideas, we did two studies in which all participants went through study-test cycles of single category lists while we manipulated the nature of the recognition tests. The recognition tests either included only same-category lures or only different-category lures. The experience of repeated testing leads participants to avoid conceptual-based strategies but only when conceptual knowledge was poorly diagnostic for recognition (i.e., in the same-category lures condition). In a second study with a similar manipulation, we showed that repeated testing with lures from the same category as study items improved performance in a final recall surprise test compared to conditions in which different-category lures were used. Such a difference is akin to the one obtained when encoding instructions focus on distinctive item features compared to cases in which the focus is on relational processing. We suggest that testing requirements lead to adaptive changes at encoding.

The enduring impact of maladaptive personality traits on relationship quality and health in later life.

Over the past 5 years, the St. Louis Personality and Aging Network (SPAN) has been collecting data on personality in later life with an emphasis on maladaptive personality, social integration, and health outcomes in a representative sample of 1,630 adults aged 55-64 living in the St. Louis area. This program has confirmed the importance of considering both the normal range of personality and in particular the role of maladaptive traits in order to understand individuals' relationships, life events, and health outcomes. In the current article, we discuss the explanatory benefits of considering maladaptive traits or traits associated with personality disorders when discussing the role of personality in social and health outcomes, with an emphasis on adults in middle to later life, and integrate these findings into the greater literature.

False recognition of objects in visual scenes: findings from a combined direct and indirect memory test.

We report an extension of the procedure devised by Weinstein and Shanks (Memory & Cognition 36:1415-1428, 2008) to study false recognition and priming of pictures. Participants viewed scenes with multiple embedded objects (seen items), then studied the names of these objects and the names of other objects (read items). Finally, participants completed a combined direct (recognition) and indirect (identification) memory test that included seen items, read items, and new items. In the direct test, participants recognized pictures of seen and read items more often than new pictures. In the indirect test, participants' speed at identifying those same pictures was improved for pictures that they had actually studied, and also for falsely recognized pictures whose names they had read. These data provide new evidence that a false-memory induction procedure can elicit memory-like representations that are difficult to distinguish from "true" memories of studied pictures.

The effect of question order on evaluations of test performance: how does the bias evolve?

Weinstein and Roediger (Memory & Cognition 38:366-376, 2010) found that manipulating the order of questions on a general knowledge quiz resulted in differing evaluations of performance at the end of the quiz: Irrespective of their actual performance, participants were consistently more optimistic about their performance when questions were given in an easy-to-hard order. In the present experiment, the participants were stopped 10 times throughout a 100-item test and asked to evaluate their performance on the last 10 questions they had answered, as well as rating their impressions of the test so far and predicting their final performance. Arranging the questions from the easiest to the hardest produced more optimistic performance evaluations on each block than did an analogous hard-easy question order, even though performance on the two versions did not differ significantly as a function of question order. Furthermore, the ratings of item difficulty on each block of 10 questions were asymmetrical in the two conditions, with a higher sensitivity to increasing as compared to decreasing question difficulty. On the other hand, the item-by-item ratings and predictions remained unaffected by question order. Our findings are best explained by an anchoring interpretation, which suggests that students fail to adjust their evaluations of performance as the difficulty of the questions changes across the test.

Testing improves true recall and protects against the build-up of proactive interference without increasing false recall.

Retrieval practice has been shown to protect against the negative effects of previously learned information on the learning of subsequent information, while increasing retention of new information. We report three experiments investigating the impact of retrieval practice on false recall in a multiple list paradigm. In three different experimental designs participants studied blocks of interrelated words that converged on non-presented associates. Participants were tested either after every study block or only after the fifth study block, and both groups received a cumulative test on all five study blocks. Overall the results from all three different experimental designs point to a benefit of testing in increasing long-term veridical recall on the cumulative test. More importantly, this improvement in veridical recall did not come at a cost: False recall on the cumulative test did not increase from retrieval practice.

Retrospective bias in test performance: Providing easy items at the beginning of a test makes students believe they did better on it.

We examined the effect of three variables (test list structure, report option, and framing) on retrospective bias in global evaluations of test performance (postdictions). Participants answered general knowledge questions and estimated correctness of their performance after each block. The ordering of the questions within a block affected bias: Participants believed they had answered more questions correctly when questions were sorted from the easiest to the hardest than when the same questions were randomized or sorted from the hardest to the easiest. This bias was obtained on global postdictions but was not apparent on item-by-item ratings, pointing to a memory-based phenomenon. In addition, forcing participants to produce a response to every question increased performance without affecting evaluations. Finally, framing the evaluation question in terms of the number of questions answered incorrectly (rather than the number correctly answered) did not affect how positively participants evaluated their performance, but did render postdictions less accurate. Our results provide evidence that students' evaluations of performance after a test are prone to retrospective memory biases.

Rapid induction of false memory for pictures.

Recognition of pictures is typically extremely accurate, and it is thus unclear whether the reconstructive nature of memory can yield substantial false recognition of highly individuated stimuli. A procedure for the rapid induction of false memories for distinctive colour photographs is proposed. Participants studied a set of object pictures followed by a list of words naming those objects, but embedded in the list were names of unseen objects. When subsequently shown full colour pictures of these unseen objects, participants consistently claimed that they had seen them, while discriminating with high accuracy between studied pictures and new pictures whose names did not appear in the misleading word list. These false memories can be reported with high confidence as well as the feeling of recollection. This new procedure allows the investigation of factors that influence false memory reports with ecologically valid stimuli and of the similarities and differences between true and false memories.

True and false memories in the DRM paradigm on a forced choice test.

Participants studied lists of semantic associates that converged on a non-presented critical word (e.g., sleep; Deese, 1959; Roediger & McDermott, 1995) and took a two-alternative forced choice test. At test, each critical non-presented word was paired with a studied word from the same list. The test was administered either immediately or 7 days after the study phase. Accuracy in distinguishing between the non-presented critical word and the studied list word was above chance at immediate testing. After a 7-day retention interval, however, accuracy did not differ from chance performance: participants were as likely to choose the non-presented critical word as the studied list word.

Can cognitive processes help explain the success of instructional techniques recommended by behavior analysts?

The fields of cognitive psychology and behavior analysis have undertaken separate investigations into effective learning strategies. These studies have led to several recommendations from both fields regarding teaching techniques that have been shown to enhance student performance. While cognitive psychology and behavior analysis have studied student performance independently from their different perspectives, the recommendations they make are remarkably similar. The lack of discussion between the two fields, despite these similarities, is surprising. The current paper seeks to remedy this oversight in two ways: first, by reviewing two techniques recommended by behavior analysts-guided notes and response cards-and comparing them to their counterparts in cognitive psychology that are potentially responsible for their effectiveness; and second, by outlining some other areas of overlap that could benefit from collaboration. By starting the discussion with the comparison of two specific recommendations for teaching techniques, we hope to galvanize a more extensive collaboration that will not only further the progression of both fields, but also extend the practical applications of the ensuing research.

Teaching the science of learning.

The science of learning has made a considerable contribution to our understanding of effective teaching and learning strategies. However, few instructors outside of the field are privy to this research. In this tutorial review, we focus on six specific cognitive strategies that have received robust support from decades of research: spaced practice, interleaving, retrieval practice, elaboration, concrete examples, and dual coding. We describe the basic research behind each strategy and relevant applied research, present examples of existing and suggested implementation, and make recommendations for further research that would broaden the reach of these strategies.

Are you mind-wandering, or is your mind on task? The effect of probe framing on mind-wandering reports.

The last decade has seen a dramatic rise in the number of studies that utilize the probe-caught method of collecting mind-wandering reports. This method involves stopping participants during a task, presenting them with a thought probe, and asking them to choose the appropriate report option to describe their thought-state. In this experiment we manipulated the framing of this probe, and demonstrated a substantial difference in mind-wandering reports as a function of whether the probe was presented in a mind-wandering frame compared with an on-task frame. This framing effect has implications both for interpretations of existing data and for methodological choices made by researchers who use the probe-caught mind-wandering paradigm.

The effect of question order on evaluations of test performance: Can the bias dissolve?

Question difficulty order has been shown to affect students' global postdictions of test performance. We attempted to eliminate the bias by letting participants experience the question order manipulation multiple times. In all three experiments, participants answered general knowledge questions and self-evaluated their performance. In Experiment 1, participants studied questions and answers in easy-hard or hard-easy question order prior to taking a test in the same order. In Experiment 2, participants took the same test twice in the opposite question order (easy-hard then hard-easy, or hard-easy then easy-hard). In Experiment 3, participants took two different tests in the opposite question order (easy-hard then hard-easy, or hard-easy then easy-hard). In all three experiments, we were unable to eliminate the bias, which suggests that repeated exposure is insufficient to overcome a strong initial anchor.

Are Twitter and Blogs Important Tools for the Modern Psychological Scientist?

Psychological scientists have many roles, one of which is, arguably, to communicate their research findings to a broader audience. Twitter and blogging offer relatively inexpensive options for this type of outreach. Engagement in these outreach efforts can lead to career enhancement, but also comes at a cost. We examined a sample of 327 psychological scientists to determine the prevalence of this type of outreach; while the use of Twitter appears to be on the rise, blogging remains very rare. In this piece, we explore the costs and benefits for psychological scientists of blogging and engaging with the general public on Twitter, and how tweeting and blogging might relate to academic merit and varieties of fame in psychology.

On the placement of practice questions during study.

Retrieval practice improves retention of information on later tests. A question remains: When should retrieval occur during learning-interspersed throughout study or at the end of each study period? In a lab experiment, an online experiment, and a classroom study, we aimed to determine the ideal placement (interspersed vs. at-the-end) of retrieval practice questions. In the lab experiment, 64 subjects viewed slides about APA style and answered short-answer practice questions about the content or restudied the slides (restudy condition). The practice questions either appeared 1 every 1-2 slides (interspersed condition), or all at the end of the presentation (at-the-end condition). One week later, subjects returned and answered the same questions on a final test. In the online experiment, 175 subjects completed the same procedure. In the classroom study, 62 undergraduate students took quizzes as part of class lectures. Short-answer practice questions appeared either throughout the lectures (interspersed condition) or at the end of the lectures (at-the-end condition). Nineteen days after the last quiz, students were given a surprise final test. Results from the 3 experiments converge in demonstrating an advantage for interspersing practice questions on the initial tests, but an absence of this advantage on the final test.

Borderline personality pathology and insomnia symptoms in community-dwelling older adults.

Prior research has associated BPD with sleep problems, but the relationship has been explored primarily in small clinical samples of younger adults. Findings from our lab have demonstrated that borderline symptoms remain present in later middle age and are associated with several negative life outcomes. A representative community sample of older adults (N = 633, Mage = 62.3) was obtained from the St Louis area, and interviewer-reports, self-reports, and informant-reports of personality pathology were completed along with an insomnia symptoms questionnaire. Cross-sectional analyses revealed that symptoms from all 10 DSM-IV personality disorders were significantly correlated with insomnia symptoms. However, after statistically controlling for major depression, body-mass index, race and gender, only borderline personality pathology remained significantly associated with insomnia symptoms. Our results demonstrate that in addition to other negative health outcomes, borderline personality pathology is uniquely associated with sleep problems in later middle-aged adults in the community.

The role of test expectancy in the build-up of proactive interference in long-term memory.

We examined the hypothesis that interpolated testing in a multiple list paradigm protects against proactive interference by sustaining test expectancy during encoding. In both experiments, recall on the last of 5 word lists was compared between 4 conditions: a tested group who had taken tests on all previous lists, an untested group who had not taken any tests on previous lists, and 2 other groups (one tested and the other untested) who were warned about the upcoming test prior to study of the fifth list. In both experiments, the untested/warned group performed significantly better than the untested/unwarned group on both correct recall and prior list intrusions but did not achieve the same recall accuracy as tested groups. In Experiment 2, an instruction manipulation check further narrowed the gap between the untested/warned group and the tested groups. In addition, we verified that a reduction in test expectancy indeed occurred in the untested group compared with the tested group by asking participants to indicate how likely they believed they were to receive a test on each studied list. These findings suggest that testing protects against proactive interference largely via attentional processes and/or more effective encoding.

Prevalence of Personality Disorders at Midlife in a Community Sample: Disorders and Symptoms Reflected in Interview, Self, and Informant Reports.

This report is concerned with the prevalence of symptoms of specific personality disorders in a representative community sample and draws attention to the importance of different sources of diagnostic information. We recruited a sample of 1,630 people between the ages of 55 and 64 to participate in a study regarding personality and health. Using careful recruitment methods, our participation rate was 43 %. Participants completed the SIDP-IV interview as well as a questionnaire (self-report MAPP). Informants completed the same questionnaire (informant MAPP), describing the participant's maladaptive personality characteristics. According to the diagnostic interview, 7 % of participants met criteria for exactly one PD, 1 % met criteria for 2 or 3 PDs, and 2 % met criteria for PD NOS (defined as 10 or more miscellaneous criteria). Avoidant and obsessive compulsive PDs were the most common types. Correlations between the three sources of information indicated significant agreement among these measurement methods, but they are not redundant. In comparison to interview and self-report data, informants reported more symptoms of personality pathology (except for avoidant PD). Symptoms of personality pathology are continuously distributed, and subthreshold features may have an important impact on health and social adjustment. In this community sample, rates of co-morbidity among PDs and the proportion of PDNOS diagnoses are substantially lower than reported from clinical samples. Future research must evaluate the validity of diagnostic thresholds and competing sources of diagnostic information in relation to important life outcomes.

Can mind-wandering be timeless? Atemporal focus and aging in mind-wandering paradigms.

Recent research has examined how often mind-wandering occurs about past vs. future events. However, mind-wandering may also be atemporal, although previous investigations of this possibility have not yielded consistent results. Indeed, it is unclear what proportion of mind-wandering is atemporal, and also how an atemporal response option would affect the future-oriented bias often reported during low-demand tasks used to measure mind-wandering. The present study examined self-reported (Experiment 1) and probe-caught (Experiment 2) mind-wandering using the low-demand Sustained Attention to Response Task (SART) in younger (18-30) and older (50-73) adults in an experimental paradigm developed to measure mind-wandering using Amazon's Mechanical Turk (Mturk). Across self-reported and probe-caught mind-wandering, the atemporal response option was used at least as frequently as past or future mind-wandering options. Although older adults reported far fewer mind-wandering events, they showed a very similar temporal pattern to younger adults. Most importantly, inclusion of the atemporal report option affected performance on the SART and selectively eliminated the prospective bias in self-reported mind-wandering, but not in probe-caught mind-wandering. These results suggest that both young and older participants are often not thinking of past or future events when mind-wandering, but are thinking of events that cannot easily be categorized as either.