A nuanced view of the extent to which samples from narrow populations are scientifically problematic.

Psychologists have a traditional concern with participant samples from narrow populations and deleterious effects on researchers' ability to generalize findings. Recently, both individuals and authoritative organizations, such as the American Psychological Association, have merged this external validity concern with diversity and inclusion concerns. The American Psychological Association directive for researchers to include diverse samples seems obviously well-taken as it purports to mitigate these problems at once; it simultaneously increases external validity and promotes diversity and inclusion. However, we show that there are complications. These include problems with internal and external validity conceptualizations; that sometimes generalization failures can support, rather than detract from, external validity; the crucial role auxiliary assumptions play in impacting internal and external validity; Lakatosian degenerative science and its problematic application; and distinguishing between merely including diverse groups in research samples versus analyzing for group differences. These complications imply a nuanced perspective of whether samples from narrow populations are undesirable. That a sample is from a narrow population might, or might not, preclude strong support or disconfirmation for the theory, including its ability to generalize. Our nuanced perspective militates against the current trend of journal directives to require diverse samples. Sample suitability for particular researcher goals should be judged on a case-by-case basis that takes into account that sometimes samples from narrow populations can nevertheless engender impressive scientific progress and sometimes not. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Couple relationship functioning and social adjustment during the transition to parenthood among fathers with a history of maltreatment.

Study of fathers has gained significant traction over recent decades. However, the experience for men over the transition to parenthood remains focused on high-socioeconomic and socially advantaged fathers. Researchers have yet to thoroughly investigate how fathers may uniquely experience this transition period with a history of childhood maltreatment, given that childhood abuse is known to impact several components of development and relationship functioning into adulthood. The current study endeavored to fill this gap by evaluating the associations between fathers' childhood experiences of physical and emotional abuse and their relationship functioning over the transition to parenthood in terms of both the couple relationship and social adjustment in relationships with others. Using data from 399 fathers who participated in a randomized control trial during pregnancy, the results from stepwise regressions indicate fathers with a history of emotional abuse experience particular declines in their external relationships (reductions in social support and increases in social stress) from prenatal (Wave 1) to postpartum (Wave 2) reports. However, no significant association emerged between fathers' history of maltreatment and their relationship functioning with their partners. These results underscore the importance of investigating the impact of different types of abuse on men in fatherhood. Moreover, we emphasize the need to study further fathers' social adjustment over the transition to parenthood beyond the couple relationship and broad social support to address the needs of men with a history of maltreatment in their new role as fathers.

An item response theory approach to the measurement of working memory capacity.

Complex span tasks are perhaps the most widely used paradigm to measure working memory capacity (WMC). Researchers assume that all types of complex span tasks assess domain-general WM. However, most research supporting this claim comes from factor analysis approaches that do not examine task performance at the item level, thus not allowing comparison of the characteristics of verbal and spatial complex span tasks. Item response theory (IRT) can help determine the extent to which different complex span tasks assess domain-general WM. In the current study, spatial and verbal complex span tasks were examined using IRT. The results revealed differences between verbal and spatial tasks in terms of item difficulty and block difficulty, and showed that most subjects with below-average ability were able to answer most items correctly across all tasks. In line with previous research, the findings suggest that examining domain-general WM by using only one task might elicit skewed scores based on task domain. Further, visuospatial complex span tasks should be prioritized as a measure of WMC if resources are limited.

On the psychometric evaluation of cognitive control tasks: An Investigation with the Dual Mechanisms of Cognitive Control (DMCC) battery.

The domain of cognitive control has been a major focus of experimental, neuroscience, and individual differences research. Currently, however, no theory of cognitive control successfully unifies both experimental and individual differences findings. Some perspectives deny that there even exists a unified psychometric cognitive control construct to be measured at all. These shortcomings of the current literature may reflect the fact that current cognitive control paradigms are optimized for the detection of within-subject experimental effects rather than individual differences. In the current study, we examine the psychometric properties of the Dual Mechanisms of Cognitive Control (DMCC) task battery, which was designed in accordance with a theoretical framework that postulates common sources of within-subject and individual differences variation. We evaluated both internal consistency and test-retest reliability, and for the latter, utilized both classical test theory measures (i.e., split-half methods, intraclass correlation) and newer hierarchical Bayesian estimation of generative models. Although traditional psychometric measures suggested poor reliability, the hierarchical Bayesian models indicated a different pattern, with good to excellent test-retest reliability in almost all tasks and conditions examined. Moreover, within-task, between-condition correlations were generally increased when using the Bayesian model-derived estimates, and these higher correlations appeared to be directly linked to the higher reliability of the measures. In contrast, between-task correlations remained low regardless of theoretical manipulations or estimation approach. Together, these findings highlight the advantages of Bayesian estimation methods, while also pointing to the important role of reliability in the search for a unified theory of cognitive control.

The Structure of Cognitive Abilities and Associations with Problem Behaviors in Early Adolescence: An Analysis of Baseline Data from the Adolescent Brain Cognitive Development Study.

Using baseline data (n = 9875) from the Adolescent Brain Cognitive Development (ABCD) Study examining children aged 9 to 10 years, the current analyses included: (1) exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) of neurocognitive measures administered during baseline collection, and (2) linear regression analyses on the Child Behavior Checklist (CBCL), controlling for demographic and socioeconomic factors. The neurocognitive tasks measured episodic memory, executive function (EF; attention), language skills, processing speed, working memory, visuospatial ability, and reasoning. The CBCL included composite scores of parent-reported internalizing, externalizing, and stress-related behavior problems. The study reported here serves as an extension of prior research using a principal components analysis (PCA) of the ABCD baseline data. We propose an alternative solution using factor analysis. Analyses revealed a three-factor structure: verbal ability (VA), executive function/processing speed (EF/PS), and working memory/episodic memory (WM/EM). These factors were significantly correlated with the CBCL scores, albeit with small effect sizes. These findings provide a novel three-factor solution to the structure of cognitive abilities measured in the ABCD Study, offering new insights into the association between cognitive function and problem behaviors in early adolescence.

The Dual Mechanisms of Cognitive Control (DMCC) project: Validation of an online behavioural task battery.

Cognitive control serves a crucial role in human higher mental functions. The Dual Mechanisms of Control theoretical framework provides a unifying account that decomposes cognitive control into two qualitatively distinct mechanisms-proactive control and reactive control. Here, we describe the Dual Mechanisms of Cognitive Control (DMCC) task battery, which was developed to probe cognitive control modes in a theoretically targeted manner, along with detailed descriptions of the experimental manipulations used to encourage shifts to proactive or reactive mode in each of four prototypical domains of cognition: selective attention, context processing, multitasking, and working memory. We present results from this task battery, conducted from a large (N > 100), online sample that rigorously evaluates the group effects of these manipulations in primary indices of proactive and reactive control, establishing the validity of the battery in providing dissociable yet convergent measures of the two cognitive control modes. The DMCC battery may be a useful tool for the research community to examine cognitive control in a theoretically targeted manner across different individuals and groups.

Working memory capacity and dual mechanisms of cognitive control: An experimental-correlational approach.

Working memory is thought to be strongly related to cognitive control. Recent studies have sought to understand this relationship under the prism of the dual mechanisms of control (DMC) framework, in which cognitive control is thought to operate in two distinct modes: proactive and reactive. Several authors have concluded that a high working memory capacity is associated with a tendency to engage the more effective mechanism of proactive control. However, the predicted pattern of proactive control use has never been observed; correlational evidence is made difficult to interpret by the overall superiority of participants with a high working memory capacity: they tend to perform better even when proactive control should be detrimental. In two experiments, we used an experimental-correlational approach to experimentally induce the use of reactive or proactive control in the AX-CPT. The relation between working memory capacity and performance was unaffected, incompatible with the hypothesis that the better performance of participants with a high working memory capacity in the task is due to their use of proactive control. It remains unclear how individual differences in working memory capacity relate to cognitive control under the DMC framework.

The impact of auditory distraction on reading comprehension: An individual differences investigation.

Background noise disrupts auditory selective attention and impairs performance on cognitive tasks, but the degree to which it is disruptive depends on the task and the individual. According to the load theory of attention and cognitive control, selective attention is influenced by both the perceptual load and the cognitive load of the primary task. Recent studies suggest that hard-to-read font in a reading task may shield attention against background noise and auditory distraction. The current study examined the disruptive effect of background noise on reading comprehension as a function of perceptual load and cognitive load. Perceptual load was manipulated by introducing task disfluency (hard-to-read or easy-to-read font), and cognitive load was manipulated by varying the type of background noise and investigating individual differences in working memory capacity. The results suggest that high perceptual load and high working memory capacity both facilitate reading comprehension. However, contrary to previous research, neither perceptual load nor capacity moderates the disruptive effect of background noise. These results failed to support the generalizability and applicability of the shield effect of perceptual disfluency against auditory distraction during reading but supported the beneficial effect of perceptual disfluency on reading comprehension.

From the Incoming Editor.

First, let me say that I am honored to take on the role of Editor in Chief at the Journal of Intelligence [...].

Individual Differences in Attention and Intelligence: A United Cognitive/Psychometric Approach.

Process overlap theory (POT) is a new theoretical framework designed to account for the general factor of intelligence (g). According to POT, g does not reflect a general cognitive ability. Instead, g is the result of multiple domain-general executive attention processes and multiple domain-specific processes that are sampled in an overlapping manner across a battery of intelligence tests. POT explains several benchmark findings on human intelligence. However, the precise nature of the executive attention processes underlying g remains unclear. In the current paper, we discuss challenges associated with building a theory of individual differences in attention and intelligence. We argue that the conflation of psychological theories and statistical models, as well as problematic inferences based on latent variables, impedes research progress and prevents theory building. Two studies designed to illustrate the unique features of POT relative to previous approaches are presented. In Study 1, a simulation is presented to illustrate precisely how POT accounts for the relationship between executive attention processes and g. In Study 2, three datasets from previous studies are reanalyzed (N = 243, N = 234, N = 945) and reveal a discrepancy between the POT simulated model and the unity/diversity model of executive function. We suggest that this discrepancy is largely due to methodological problems in previous studies but also reflects different goals of research on individual differences in attention. The unity/diversity model is designed to facilitate research on executive function and dysfunction associated with cognitive and neural development and disease. POT is uniquely suited to guide and facilitate research on individual differences in cognitive ability and the investigation of executive attention processes underlying g.

Adult bilinguals outperform monolinguals in theory of mind.

Theory of mind (ToM) is an essential ability for social competence and communication, and it is necessary for understanding behaviours that differ from our own. Research on bilingual children has reported that 3- and 4-year-old bilinguals outperform monolinguals in ToM tasks. Research suggests that adult bilinguals also might outperform monolinguals; nevertheless, this effect has yet to be established. Here, we tested bilingual and monolingual adults on the director task. Results showed that bilingual adults outperformed monolinguals in response to perspective-dependent trials of the director task, but not in response to control trials. This suggests that bilingualism is associated with individuals' ability to take into account the perspective of another person. In addition, the number of cultures that participants were exposed to, regardless of whether the participant was bilingual or not, was also associated with ToM performance. Overall, the findings suggest that linguistic and cultural experience have an impact on ToM.

The Relationship between Theory of Mind and Intelligence: A Formative g Approach.

Theory of Mind (ToM) is the ability understand that other people's mental states may be different from one's own. Psychometric models have shown that individual differences in ToM can largely be attributed to general intelligence (g) (Coyle et al. 2018). Most psychometric models specify g as a reflective latent variable, which is interpreted as a general ability that plays a causal role in a broad range of cognitive tasks, including ToM tasks. However, an alternative approach is to specify g as a formative latent variable, that is, an overall index of cognitive ability that does not represent a psychological attribute (Kovacs and Conway 2016). Here we consider a formative g approach to the relationship between ToM and intelligence. First, we conducted an SEM with reflective g to test the hypothesis that ToM is largely accounted for by a general ability. Next, we conducted a model with formative g to determine whether the relationship between ToM and intelligence is influenced by domain-specific tasks. Finally, we conducted a redundancy analysis to examine the contribution of each g variable. Results suggest that the relationship between ToM and intelligence in this study was influenced by language-based tasks, rather than solely a general ability.

Investigating the Structure of Intelligence Using Latent Variable and Psychometric Network Modeling: A Commentary and Reanalysis.

In a recent publication in the Journal of Intelligence, Dennis McFarland mischaracterized previous research using latent variable and psychometric network modeling to investigate the structure of intelligence. Misconceptions presented by McFarland are identified and discussed. We reiterate and clarify the goal of our previous research on network models, which is to improve compatibility between psychological theories and statistical models of intelligence. WAIS-IV data provided by McFarland were reanalyzed using latent variable and psychometric network modeling. The results are consistent with our previous study and show that a latent variable model and a network model both provide an adequate fit to the WAIS-IV. We therefore argue that model preference should be determined by theory compatibility. Theories of intelligence that posit a general mental ability (general intelligence) are compatible with latent variable models. More recent approaches, such as mutualism and process overlap theory, reject the notion of general mental ability and are therefore more compatible with network models, which depict the structure of intelligence as an interconnected network of cognitive processes sampled by a battery of tests. We emphasize the importance of compatibility between theories and models in scientific research on intelligence.

The Role of Non-Cognitive Factors in the SAT Remains Unclear: A Commentary on Hannon (2019).

In the current issue of the Journal of Intelligence, Hannon (2019) reports a novel and intriguing pattern of results that could be interpreted as evidence that the SAT is biased against Hispanic students. Specifically, Hannon's analyses suggest that non-cognitive factors, such as test anxiety, contribute to SAT performance and the impact of test anxiety on the SAT is stronger among Hispanic students than European-American students. Importantly, this pattern of results was observed after controlling for individual differences in cognitive abilities. We argue that there are multiple issues with Hannon's investigation and interpretation. For instance, Hannon did not include an adequate number or variety of measures of cognitive ability. In addition, the measure of test anxiety was a retrospective self-report survey on evaluated anxiety rather than a direct measure of situational test anxiety associated with the SAT. Based on these and other observations, we conclude that Hannon's current results do not provide sufficient evidence to suggest that non-cognitive factors play a significant role in the SAT or that they impact European-American and Hispanic students differently.

Psychometric Network Analysis of the Hungarian WAIS.

The positive manifold-the finding that cognitive ability measures demonstrate positive correlations with one another-has led to models of intelligence that include a general cognitive ability or general intelligence (g). This view has been reinforced using factor analysis and reflective, higher-order latent variable models. However, a new theory of intelligence, Process Overlap Theory (POT), posits that g is not a psychological attribute but an index of cognitive abilities that results from an interconnected network of cognitive processes. These competing theories of intelligence are compared using two different statistical modeling techniques: (a) latent variable modeling and (b) psychometric network analysis. Network models display partial correlations between pairs of observed variables that demonstrate direct relationships among observations. Secondary data analysis was conducted using the Hungarian Wechsler Adult Intelligence Scale Fourth Edition (H-WAIS-IV). The underlying structure of the H-WAIS-IV was first assessed using confirmatory factor analysis assuming a reflective, higher-order model and then reanalyzed using psychometric network analysis. The compatibility (or lack thereof) of these theoretical accounts of intelligence with the data are discussed.

Benchmarks for models of short-term and working memory.

Any mature field of research in psychology-such as short-term/working memory-is characterized by a wealth of empirical findings. It is currently unrealistic to expect a theory to explain them all; theorists must satisfice with explaining a subset of findings. The aim of the present article is to make the choice of that subset less arbitrary and idiosyncratic than is current practice. We propose criteria for identifying benchmark findings that every theory in a field should be able to explain: Benchmarks should be reproducible, generalize across materials and methodological variations, and be theoretically informative. We propose a set of benchmarks for theories and computational models of short-term and working memory. The benchmarks are described in as theory-neutral a way as possible, so that they can serve as empirical common ground for competing theoretical approaches. Benchmarks are rated on three levels according to their priority for explanation. Selection and ratings of the benchmarks is based on consensus among the authors, who jointly represent a broad range of theoretical perspectives on working memory, and they are supported by a survey among other experts on working memory. The article is accompanied by a web page providing an open forum for discussion and for submitting proposals for new benchmarks; and a repository for reference data sets for each benchmark. (PsycINFO Database Record

Benchmarks provide common ground for model development: Reply to Logie (2018) and Vandierendonck (2018).

We respond to the comments of Logie and Vandierendonck to our article proposing benchmark findings for evaluating theories and models of short-term and working memory. The response focuses on the two main points of criticism: (a) Logie and Vandierendonck argue that the scope of the set of benchmarks is too narrow. We explain why findings on how working memory is used in complex cognition, findings on executive functions, and findings from neuropsychological case studies are currently not included in the benchmarks, and why findings with visual and spatial materials are less prevalent among them. (b) The critics question the usefulness of the benchmarks and their ratings for advancing theory development. We explain why selecting and rating benchmarks is important and justifiable, and acknowledge that the present selection and rating decisions are in need of continuous updating. The usefulness of the benchmarks of all ratings is also enhanced by our concomitant online posting of data for many of these benchmarks. (PsycINFO Database Record

The evolution of fluid intelligence meets formative g.

The argument by Burkart et al. in the target article relates to fluid (not general) intelligence: a domain-general ability involved in complex, novel problem solving, and strongly related to working memory and executive functions. A formative framework, under which the general factor of intelligence is the common consequence, not the common cause of the covariance among tests is more in line with an evolutionary approach.

Inducing Proactive Control Shifts in the AX-CPT.

The Dual Mechanisms of Control (DMC) account (Braver, 2012) proposes two distinct mechanisms of cognitive control, proactive and reactive. This account has been supported by a large number of studies using the AX-CPT paradigm that have demonstrated not only between-group differences, but also within-subjects variability in the use of the two control mechanisms. Yet there has been little investigation of task manipulations that can experimentally modulate the use of proactive control in healthy young adults; such manipulations could be useful to better understand the workings of cognitive control mechanisms. In the current study, a series of three experiments demonstrate how individuals can be systematically biased toward and away from the utilization of proactive control, via strategy training and no-go manipulations, respectively. These results provide increased support for the DMC framework, and provide a new basis from which to examine group-based differences and neural mechanisms underlying the two control modes.

Phonological similarity in working memory span tasks.

In a series of four experiments, we explored what conditions are sufficient to produce a phonological similarity facilitation effect in working memory span tasks. By using the same set of memoranda, but differing the secondary-task requirements across experiments, we showed that a phonological similarity facilitation effect is dependent upon the semantic relationship between the memoranda and the secondary-task stimuli, and is robust to changes in the representation, ordering, and pool size of the secondary-task stimuli. These findings are consistent with interference accounts of memory (Brown, Neath, & Chater, Psychological Review, 114, 539-576, 2007; Oberauer, Lewandowsky, Farrell, Jarrold, & Greaves, Psychonomic Bulletin & Review, 19, 779-819, 2012), whereby rhyming stimuli provide a form of categorical similarity that allows distractors to be excluded from retrieval at recall.