Large-Scale Item-Level Analysis of the Figural Matrices Test in the Norwegian Armed Forces: Examining Measurement Precision and Sex Bias.

Figural matrices tests are common in intelligence research and have been used to draw conclusions regarding secular changes in intelligence. However, their measurement properties have seldom been evaluated with large samples that include both sexes. Using data from the Norwegian Armed Forces, we study the measurement properties of a test used for selection in military recruitment. Item-level data were available from 113,671 Norwegian adolescents (32% female) tested between the years 2011 and 2017. Utilizing item response theory (IRT), we characterize the measurement properties of the test in terms of difficulty, discrimination, precision, and measurement invariance between males and females. We estimate sex differences in the mean and variance of the latent variable and evaluate the impact of violations to measurement invariance on the estimated distribution parameters. The results show that unidimensional IRT models fit well in all groups and years. There is little difference in precision and test difficulty between males and females, with precision that is generally poor on the upper part of the scale. In the sample, male latent proficiency is estimated to be slightly higher on average, with higher variance. Adjusting for measurement invariance generally reduces the sex differences but does not eliminate them. We conclude that previous studies using the Norwegian GMA data must be interpreted with more caution but that the test should measure males and females equally fairly.

Body Weight Perceptions Among Youth From 6 Countries and Associations With Social Media Use: Findings From the International Food Policy Study.

BACKGROUND: Body dissatisfaction is associated with poor psychological and physical health, particularly among young people. However, limited data exist on body size perceptions across countries and factors associated with dissatisfaction. OBJECTIVE: This study examined dissatisfaction prevalence and associations with sociodemographics and social media use among youth in 6 countries. DESIGN: Repeat cross-sectional national online surveys were conducted as part of the 2019 and 2020 International Food Policy Study Youth Survey. PARTICIPANTS: The sample included 21 277 youth aged 10 to 17 years from Australia, Canada, Chile, Mexico, the United Kingdom, and the United States. Youth were recruited to complete the online survey through parents/guardians enrolled in the Nielsen Consumer Insights Global Panel and their partners' panels. MAIN OUTCOME MEASURES: Figural drawing scales assessed self-perceived and ideal body images, with differences between scales representing body dissatisfaction. STATISTICAL ANALYSES PERFORMED: Multinomial logistic regression models examined differences in body dissatisfaction by country, and associations with sociodemographics and either social media screen time or platforms used, including 2-way interactions with country. RESULTS: Overall, approximately 45% of youth reported the same perceived and ideal body sizes, whereas 35% were "larger than ideal" (from 33% in Canada and Australia to 42% in Chile) and 20% were "thinner than ideal" (from 15% in Chile to 22% in Mexico). Greater social media screen time was associated with a higher likelihood of moderate-severe dissatisfaction for being "thinner than ideal" and at least mild dissatisfaction for being "larger than ideal" (P < .003 for all contrasts), with greater dissatisfaction among users of YouTube and Snapchat than nonusers (P ≤ .005 for both contrasts). Modest differences in body dissatisfaction between countries were observed for age, ethnicity, body mass index, and weight-based teasing. CONCLUSIONS: Body dissatisfaction is prevalent among youth across diverse countries. These findings highlight the need to promote healthy body image in youth, particularly among social media users.

An attentional approach to geometrical illusions.

It is known for a long time that some drawings composed of points, lines, and areas are systematically misperceived. The origin of these geometrical illusions is still unknown. Here we outline how a recent progress in attentional research contributes to a better understanding of such perceptual distortions. The basic idea behind this approach is that crucial elements of a drawing are differently attended. These changes in the allocation of spatial attention go along with systematic changes in low-level spatial coding. As a result, changes in the perception of spatial extent, angles, positions, and shapes can arise. How this approach can be applied to individual illusions is discussed.

The quest for psychological symmetry through figural goodness, randomness, and complexity: A selective review.

Of the four interrelated concepts in the title, only symmetry has an exact mathematical definition. In mathematical development, symmetry is a graded variable-in marked contrast with the popular binary conception of symmetry in and out of the laboratory (i.e. an object is either symmetrical or nonsymmetrical). Because the notion does not have a direct graded perceptual counterpart (experimental participants are not asked about the amount of symmetry of an object), students of symmetry have taken various detours to characterize the perceptual effects of symmetry. Current approaches have been informed by information theory, mathematical group theory, randomness research, and complexity. Apart from reviewing the development of the main approaches, for the first time we calculated associations between figural goodness as measured in the Garner tradition and measures of algorithmic complexity and randomness developed in recent research. We offer novel ideas and analyses by way of integrating the various approaches.

Measurement-Invariant Fluid Anti-Flynn Effects in Population-Representative German Student Samples (2012-2022).

Generational IQ test scores in the general population were observed to increase over time (i.e., the Flynn effect) across most of the 1900s. However, according to more recent reports, Flynn effect patterns have seemingly become less consistent. So far, most available evidence on this phenomenon has been categorized by drawing on the classic fluid vs. crystallized intelligence taxonomy. However, recent evidence suggests that subdomain-specific trajectories of IQ change may well be more complex. Here, we present evidence for cross-temporal changes in measurement-invariant figural reasoning tasks in three large-scale, population-representative samples of German secondary school students (total N = 19,474). Analyses revealed a consistent pattern of significant and meaningful declines in performance from 2012 to 2022. Results indicate a decrease in figural reasoning of 4.68 to 5.17 IQ points per decade (corresponding to small-to-medium effects, Cohen ds from 0.34 to 0.38). These findings may be interpreted as tentative evidence for a decreasing strength of the positive manifold of intelligence as a potential cause of the increasing number of recent reports about inconsistent IQ change trajectories.

Prägnanz in visual perception.

How do we perceptually and cognitively organize incoming stimulation? A century ago, Gestalt psychologists posited the law of Prägnanz: psychological organization will always be as 'good' as possible given the prevailing conditions. To make the Prägnanz law a useful statement, it needs to be specified further (a) what a 'good' psychological organization entails, (b) how the Prägnanz tendency can be realized, and (c) which conditions need to be taken into account. Although the Gestalt school did provide answers to these questions, modern-day mentions of Prägnanz or good Gestalt often lack these clarifications. The concept of Prägnanz has been (mis)understood in many different ways, and by looking back on the rich history of the concept, we will attempt to present a more fine-grained view and promote a renewed understanding of the central role of Prägnanz in visual perception and beyond. We review Gestalt psychology's answers to the questions listed above, and also discuss the four main uses of the Prägnanz concept in more detail: (a) a Prägnanz tendency in each organizational process, (b) Prägnanz as a property of a Gestalt, (c) Prägnanz steps as internal reference points, and (d) Prägnanz in relation to aesthetic appreciation. As a key takeaway, Prägnanz is a multifaceted Gestalt psychological concept indicating the "goodness" of an experienced organization. Both the removal of unnecessary details and the emphasis on characteristic features of the overall organization compared to a reference organization can contribute to the emergence of a 'better' Gestalt. The stimulus constellation is not the only factor in determining the goodness of an organization, also the stimulus' interaction with an individual in a specific spatial and temporal context plays a role. Taking the ideas on Prägnanz as a generative framework and keeping the original Gestalt psychological context in mind, future research on perceptual organization can improve our understanding of the principles underlying psychological organization by further specifying how different organizational principles interact in concrete situations. Public significance statement: This paper reviews what a 'good' psychological organization entails, and how the incoming stimulation is clarified in human perception to achieve the best possible psychological organization. The review debunks common misconceptions on the meaning of "goodness" and synthesizes the most important perspectives and developments on "goodness" from its conception until now.

Testing Replicability and Generalizability of the Time on Task Effect.

The time on task (ToT) effect describes the relationship of the time spent on a cognitive task and the probability of successful task completion. The effect has been shown to vary in size and direction across tests and even within tests, depending on the test taker and item characteristics. Specifically, investing more time has a positive effect on response accuracy for difficult items and low ability test-takers, but a negative effect for easy items and high ability test-takers. The present study sought to test the replicability of this result pattern of the ToT effect across samples independently drawn from the same populations of persons and items. Furthermore, its generalizability was tested in terms of differential correlations across ability tests. To this end, ToT effects were estimated for three different reasoning tests and one test measuring natural sciences knowledge in 10 comparable subsamples with a total N = 2640. Results for the subsamples were highly similar, demonstrating that ToT effects are estimated with sufficient reliability. Generally, faster answers tended to be more accurate, suggesting a relatively effortless processing style. However, with increasing item difficulty and decreasing person ability, the effect flipped to the opposite direction, i.e., higher accuracy with longer processing times. The within-task moderation of the ToT effect can be reconciled with an account on effortful processing or cognitive load. By contrast, the generalizability of the ToT effect across different tests was only moderate. Cross-test relations were stronger in relative terms if performance in the respective tasks was more strongly related. This suggests that individual differences in the ToT effect depend on test characteristics such as their reliabilities but also similarities and differences of their processing requirements.

Construction and Validation of the HeiQ: An Operation-Oriented Figural Matrices Test.

Figural matrices tests are among the most popular and well-investigated tests used to assess inductive reasoning abilities. Solving these tests requires the selection of a target that completes a figural matrix among distractors. Despite their generally good psychometric properties, previous matrices tests have limitations associated with distractor construction that prevent them from realizing their full potential. Most tests allow participants to identify the correct response by eliminating distractors based on superficial features. The goal of this study was to develop a novel figural matrices test which is less prone to the use of response elimination strategies, and to test its psychometric properties. The new test consists of 48 items and was validated with N = 767 participants. Measurement models implied that the test is Rasch scalable, inferring a uniform underlying ability. The test showed good to very good reliability (retest-correlation: r = 0.88; Cronbach's alpha: α = 0.93; split-half reliability: r = 0.88) and good construct validity (r = 0.81 with the Raven Progressive Matrices Test, r = 0.73 with global intelligence scores of the Intelligence Structure Test 2000R, and r = 0.58 with the global score of the Berlin Intelligence Structure Test). It even superseded the Raven Progressive Matrices Tests in criterion-related validity (correlation with final year high school grades (r = -0.49 p < .001)). We conclude that this novel test has excellent psychometric properties and can be a valuable tool for researchers interested in reasoning assessment.

A Log File Analysis on the Validity of Partial Solutions in Figural Matrices Tests.

As a component of many intelligence test batteries, figural matrices tests are an effective way to assess reasoning, which is considered a core ability of intelligence. Traditionally, the sum of correct items is used as a performance indicator (total solution procedure). However, recent advances in the development of computer-based figural matrices tests allow additional indicators to be considered for scoring. In two studies, we focused on the added value of a partial solution procedure employing log file analyses from a computer-based figural matrices test. In the first study (n = 198), we explored the internal validity of this procedure by applying both an exploratory bottom-up approach (using sequence analyses) and a complementary top-down approach (using rule jumps, an indicator taken from relevant studies). Both approaches confirmed that higher scores in the partial solution procedure were associated with higher structuredness in participants' response behavior. In the second study (n = 169), we examined the external validity by correlating the partial solution procedure in addition to the total solution procedure with a Grade Point Average (GPA) criterion. The partial solution procedure showed an advantage over the total solution procedure in predicting GPA, especially at lower ability levels. The implications of the results and their applicability to other tests are discussed.

Development, Validation, and Measurement Invariance of the Body Image Bidimensional Assessment (BIBA) in Italian and Spanish Children and Early Adolescent Samples.

Body dissatisfaction (BD) is an important public health issue as it negatively influences the physical and psychosocial wellbeing of children/early adolescents. Available measures of BD for this population are scarce, have a significant bias, or only evaluate weight-related dissatisfaction. This study, through the exploratory factor analysis (EFA), aims to develop and validate the Italian (Study 1) and Spanish (Study 2) versions of a new tool, the Body Image Bidimensional Assessment (BIBA), which is not subject to sex-age-race biases and is able to identify BD related to weight and height among children/early adolescents. Study 3 regards the confirmatory factor analysis (CFA), testing the measurement of invariance across sex and country. The BIBA has a two-factor structure (i.e., weight and height dissatisfaction) according to studies 1 and 2. McDonald's ω ranged from 0.73 (weight) and 0.72 (height) with good reliability. CFA confirmed the two-factor model as a good fit for the Italian and Spanish samples. Finally, partial metric and scalar invariance of the BIBA dimensions across sexes and nations emerged. The BIBA has proven to be an easy-to-use tool that identifies two BD dimensions among children/early adolescents who could benefit from prompt educational interventions.

Investigating the involvement of cognitive control processes in innovative and adaptive creativity and their age-related changes.

Introduction: Based on the two-factor model of creativity, two distinct types of creative problem solving can be differentiated: innovative ("do things differently") and adaptive ("do things better"). Flexible cognitive control is a crucial concept in connection with both general and specific styles of creativity: innovative problem-solving benefits from broader attention and flexible mental set shifting; while adaptive creativity relies on focused attention and persistent goal-oriented processes. We applied an informatively cued task-switching paradigm which is suitable for measuring different cognitive control processes and mechanisms like proactive and reactive control. We hypothesized that adaptive creativity is connected to effective proactive control processes, while innovative creativity is based on reactive task-execution. As we have found no previous evidence how age-related changes in cognitive control affects creative cognition; we also examined the effect of healthy aging on different problem-solving styles in an explorative way. Methods: Our participants, 37 younger (18-30 years) and 37 older (60-75 years) adults, were divided into innovative and adaptive creative groups according to the Torrance Test of Creative Thinking's Figural Subtest (Hungarian version). Results: Our results showed that among younger adults the adaptively creative group had larger cue-locked CNV component (effective preparatory activity connected to proactive control), while the innovatively creative group had a larger target-locked P3b component (effective target evaluation and categorization in line with reactive control) which supports a functional difference in the two creative styles. By contrast, in older adults innovative problem-solving showed larger mixing costs (less effective maintenance and selection of task sets), and the lack of trial type effect on target-locked N2b (target-induced goal reactivation and less effective conflict resolution); while adaptive problem-solving caused them to make fewer errors (accuracy-oriented behavior). Discussion: All in all, innovative and adaptive creativity is based on distinct cognitive control mechanisms in both age-groups, but their processing level is affected by age-related changes.

The Somatomorphic Matrix-Female: More evidence for the validity of bidimensional figural rating scales for women.

Our study aimed to develop and provide a preliminary psychometric validation of the Somatomorphic Matrix-Female (SM-F), a new bidimensional female figural rating scale which can be used to gauge actual and desired levels of both body fat and muscularity in a consolidated measure, as well as providing an index of actual-desired body discrepancy based on these measures. Across two studies undergraduate women (n Study 1 = 481; n Study 2 = 391) completed the Eating Disorder Examination-Questionnaire, the Body Shape Questionnaire-34, and the Depression Anxiety Stress Scales-21 (Study 1) and the Drive for Thinness Scale and the Drive for Muscularity Scale (Study 2), as well as the SM-F. Overall, the SM-F demonstrated sound content, concurrent, and convergent validity for actual and desired body fat, actual and desired muscularity, and their respective discrepancy scores.

Towards the Validation of Executive Functioning Assessments: A Clinical Study.

Neuropsychological assessment needs a more profound grounding in psychometric theory. Specifically, psychometrically reliable and valid tools are required, both in patient care and in scientific research. The present study examined convergent and discriminant validity of some of the most popular indicators of executive functioning (EF). A sample of 96 neurological inpatients (aged 18-68 years) completed a battery of standardized cognitive tests (Raven's matrices, vocabulary test, Wisconsin Card Sorting Test, verbal fluency test, figural fluency test). Convergent validity of indicators of intelligence (Raven's matrices, vocabulary test) and of indicators of EF (Wisconsin Card Sorting Test, verbal fluency test, figural fluency) were calculated. Discriminant validity of indicators of EF against indicators of intelligence was also calculated. Convergent validity of indicators of intelligence (Raven's matrices, vocabulary test) was good (rxtyt = 0.727; R2 = 0.53). Convergent validity of fluency indicators of EF against executive cognition as indicated by performance on the Wisconsin Card Sorting Test was poor (0.087 ≤ rxtyt ≤ 0.304; 0.008 ≤ R2 ≤ 0.092). Discriminant validity of indicators of EF against indicators of intelligence was good (0.106 ≤ rxtyt ≤ 0.548; 0.011 ≤ R2 ≤ 0.300). Our conclusions from these data are clear-cut: apparently dissimilar indicators of intelligence converge on general intellectual ability. Apparently dissimilar indicators of EF (mental fluency, executive cognition) do not converge on general executive ability. Executive abilities, although non-unitary, can be reasonably well distinguished from intellectual ability. The present data contribute to the hitherto meager evidence base regarding the validity of popular indicators of EF.

Development and Validation of the Open Matrices Item Bank.

Figural matrices tasks are one of the most prominent item formats used in intelligence tests, and their relevance for the assessment of cognitive abilities is unquestionable. However, despite endeavors of the open science movement to make scientific research accessible on all levels, there is a lack of royalty-free figural matrices tests. The Open Matrices Item Bank (OMIB) closes this gap by providing free and unlimited access (GPLv3 license) to a large set of empirically validated figural matrices items. We developed a set of 220 figural matrices based on well-established construction principles commonly used in matrices tests and administered them to a sample of N = 2572 applicants to medical schools. The results of item response models and reliability analyses demonstrate the excellent psychometric properties of the items. In the discussion, we elucidate how researchers can already use the OMIB to gain access to high-quality matrices tests for their studies. Furthermore, we provide perspectives for features that could additionally improve the utility of the OMIB.

Association of Endogenous Erythropoietin Levels and Iron Status With Cognitive Functioning in the General Population.

Background: Emerging data suggest that erythropoietin (EPO) promotes neural plasticity and that iron homeostasis is needed to maintain normal physiological brain function. Cognitive functioning could therefore be influenced by endogenous EPO levels and disturbances in iron status. Objective: To determine whether endogenous EPO levels and disturbances in iron status are associated with alterations in cognitive functioning in the general population. Materials and Methods: Community-dwelling individuals from the Prevention of Renal and Vascular End-Stage Disease (PREVEND) study, a general population-based cohort in Groningen, Netherlands, were surveyed between 2003 and 2006. Additionally, endogenous EPO levels and iron status, consisting of serum iron, transferrin, ferritin, and transferrin saturation were analyzed. Cognitive function was assessed by scores on the Ruff Figural Fluency Test (RFFT), as a reflection of executive function, and the Visual Association Test (VAT), as a reflection of associative memory. Results: Among 851 participants (57% males; mean age 60 ± 13 years), higher endogenous EPO levels were independently associated with an improved cognitive function, reflected by RFFT scores (ß = 0.09, P = 0.008). In multivariable backward linear regression analysis, EPO levels were among the most important modifiable determinants of RFFT scores (ß = 0.09, P = 0.002), but not of VAT scores. Of the iron status parameters, only serum ferritin levels were inversely associated with cognitive function, reflected by VAT scores, in multivariable logistic regression analysis (odds ratio, 0.77; 95% confidence interval 0.63-0.95; P = 0.02 for high performance on VAT, i.e., ≥11 points). No association between iron status parameters and RFFT scores was identified. Conclusion: The findings suggest that endogenous EPO levels and serum ferritin levels are associated with specific cognitive functioning tests in the general population. Higher EPO levels are associated with better RFFT scores, implying better executive function. Serum ferritin levels, but not other iron status parameters, were inversely associated with high performance on the VAT score, implying a reduced ability to create new memories and recall recent past. Further research is warranted to unravel underlying mechanisms and possible benefits of therapeutic interventions.

Measures of figural fluency: Relationship to neuropsychological variables and traumatic brain injury severity.

Figural fluency tests were originally developed as a measure of right frontal lobe integrity and are presently a standard component of neuropsychological evaluation. To better understand the clinical interpretation of figural fluency scores (design output and perseverative errors), the current study investigated two trials from the Ruff Figural Fluency Test (RFFT) and their correlations with other neuropsychological variables in examinees who were being evaluated for cognitive difficulties (N = 84). Design output was significantly correlated (rs > .4) with psychomotor speed, non-verbal memory, and false positive recognition errors on a verbal memory test, while perseverative errors did not show a significant correlation with these variables or with design output. Design output also showed a significant correlation with phonemic fluency (rs > .3) as well as correlations (rs > .25) with semantic fluency and intellectual functioning. In a sample of examinees with mild (n = 33), complicated-mild (n = 11), and moderate-severe (n = 16) traumatic brain injuries (TBI), group differences in design output did not reach significance, whereas perseverative errors were significantly related to the severity of injury. This study suggests that design output and perseverative errors on figural fluency may be separate measures, and their clinical interpretations are discussed.

Structural Beauty: A Structure-Based Computational Approach to Quantifying the Beauty of an Image.

To say that beauty is in the eye of the beholder means that beauty is largely subjective so varies from person to person. While the subjectivity view is commonly held, there is also an objectivity view that seeks to measure beauty or aesthetics in some quantitative manners. Christopher Alexander has long discovered that beauty or coherence highly correlates to the number of subsymmetries or substructures and demonstrated that there is a shared notion of beauty-structural beauty-among people and even different peoples, regardless of their faiths, cultures, and ethnicities. This notion of structural beauty arises directly out of living structure or wholeness, a physical and mathematical structure that underlies all space and matter. Based on the concept of living structure, this paper develops an approach for computing the structural beauty or life of an image (L) based on the number of automatically derived substructures (S) and their inherent hierarchy (H). To verify this approach, we conducted a series of case studies applied to eight pairs of images including Leonardo da Vinci's Mona Lisa and Jackson Pollock's Blue Poles. We discovered among others that Blue Poles is more structurally beautiful than the Mona Lisa, and traditional buildings are in general more structurally beautiful than their modernist counterparts. This finding implies that goodness of things or images is largely a matter of fact rather than an opinion or personal preference as conventionally conceived. The research on structural beauty has deep implications on many disciplines, where beauty or aesthetics is a major concern such as image understanding and computer vision, architecture and urban design, humanities and arts, neurophysiology, and psychology.

Testing the discrepancy between actual and ideal body image with the Implicit Relational Assessment Procedure (IRAP).

BACKGROUND: The discrepancy between actual and ideal body image is considered an index of body dissatisfaction and a risk factor for eating disorders. While discrepancy has been traditionally tested with figural drawing rating scales, in recent times the use of implicit measures has been explored. METHODS: This study employs the Implicit Relational Assessment Procedure (IRAP) to examine actual-ideal body-size discrepancy in a sample of 130 Spanish college students, as well as its utility to predict symptoms of eating disorders and other body-image relevant measures. Participants completed the Contour Drawing Rating Scale (CDRS). The three smallest and the three largest contour drawings of the CDRS were used as target stimuli in two different IRAP tasks: one in combination with the sample phrases "I am" and "I am not" (that assessed implicit actual body image), another in combination with the phrases "I want to be" and "I don't want to be" (that assessed implicit ideal body image). After completing both IRAP tasks, participants completed explicit measures of body-image psychological inflexibility, body dissatisfaction, and symptoms of eating disorders. RESULTS: Results showed a small implicit bias towards thinness. Participants were faster in affirming than denying that they are thin and that they desire to be thin. They were also faster in affirming than denying that they are fat and that they want to be fat, but to a smaller extent than with thinness. Specifically, the implicit desire to be (or not be) fat emerged as an independent predictor of eating disorder symptoms, psychological inflexibility, and body dissatisfaction that significantly increased the predictive power of CDRS scores. CONCLUSIONS: These findings underscore the need for further research on specific body image implicit beliefs towards fatness, both in subclinical and clinical populations, in order to examine whether willingness to accept the idea that one can have a larger body size can be a suitable target for prevention and intervention in eating disorders.

Body dissatisfaction can be thought of as the discrepancy between actual and desired body size. This is typically measured with rating scales depicting a series of body silhouettes of increasing size, from extreme thinness to fatness. Respondents mark the points that match their current body size and the one they would ideally like to be (the more distance between both, the more body dissatisfaction). Like all self-reports, these scales are liable to self-presentation biases. Experimental procedures that require respondents to answer under time pressure (implicit measures) tap into more automatic reactions that are less amenable to deliberate manipulation. This study used one such procedure (the IRAP) to examine how rapidly participants identified themselves (or not) with pictures of underweight or overweight, and how rapidly they expressed a desire to be (or not) like such pictures. Participants did not show a clear discrepancy between their actual and their ideal body size with the IRAP. However, automatic reactions indicative of acceptance/rejection of the idea of becoming fatter, predicted the degree of body image distress as measured with different instruments. Unwillingness to accept this idea was associated with more severe symptoms of disordered eating.

Test Preparation in Figural Matrices Tests: Focus on the Difficult Rules.

It is well documented that training the rules employed in figural matrices tests enhances test performance. Previous studies only compare experimental conditions in which all or no rules were trained and therefore ignore the particular influence of knowledge about the easy and difficult rules. With the current study, we wanted to provide some first insights into this topic. Respondents were assigned to four groups that received training for no rules, only the easy rules, only the difficult rules, or for all rules. The results show that a training only for the difficult rules was more effective than the other trainings. This applies also to performance in the easy rules that were actually not part of the training. A possible explanation for this finding is a facilitation of the solution process that is primarily driven by knowledge about the difficult rules. In conclusion, our results demonstrate that taking differences between the rules into account may provide a deeper understanding of the effects of trainings for figural matrices tests.

The validity and reliability of a digital Ruff Figural Fluency Test (RFFT).

BACKGROUND: The Ruff Figural Fluency Test (RFFT) is a valid but time-consuming and labour-intensive cognitive paper-and-pencil test. A digital RFFT was developed that can be conducted independently using an iPad and Apple Pencil and RFFT scores are computed automatically. We investigated the validity and reliability of this digital RFFT. METHODS: We randomly allocated participants to the digital or paper-and-pencil RFFT. After the first test, the other test was performed immediately (cross-over). Participants were invited for a second digital RFFT 1 week later. For the digital RFFT, an (automatic) algorithm and two independent raters (criterion standard) assessed the number of unique designs (UD) and perseverative errors (PE). These raters also assessed the paper-and-pencil RFFT. We used Intraclass correlation coefficients (ICC), sensitivity, specificity, %-agreement, Kappa, and Bland-Altman plots. RESULTS: We included 94 participants (mean (SD) age 39.9 (14.8), 73.4% follow-up). Mean (SD) UD and median (IQR) PE of the digital RFFT were 84.2 (26.0) and 4 (2-7.3), respectively. Agreement between manual and automatic scoring of the digital RFFT was high for UD (ICC = 0.99, 95% CI 0.98, 0.99, sensitivity = 0.98; specificity = 0.96) and PE (ICC = 0.99, 95% CI 0.98, 0.99; sensitivity = 0.90, specificity = 1.00), indicating excellent criterion validity. Small but significant differences in UD were found between the automatic and manual scoring (mean difference: - 1.12, 95% CI - 1.92, - 0.33). Digital and paper-and-pencil RFFT had moderate agreement for UD (ICC = 0.73, 95% CI 0.34, 0.87) and poor agreement for PE (ICC = 0.47, 95% CI 0.30, 0.62). Participants had fewer UD on the digital than paper-and-pencil RFFT (mean difference: - 7.09, 95% CI - 11.80, - 2.38). The number of UD on the digital RFFT was associated with higher education (Spearman's r = 0.43, p < 0.001), and younger age (Pearson's r = - 0.36, p < 0.001), showing its ability to discriminate between different age categories and levels of education. Test-retest reliability was moderate (ICC = 0.74, 95% CI 0.61, 0.83). CONCLUSIONS: The automatic scoring of the digital RFFT has good criterion and convergent validity. There was low agreement between the digital RFFT and paper-and-pencil RFFT and moderate test-retest reliability, which can be explained by learning effects. The digital RFFT is a valid and reliable instrument to measure executive cognitive function among the general population and is a feasible alternative to the paper-and-pencil RFFT in large-scale studies. However, its scores cannot be used interchangeably with the paper-and-pencil RFFT scores.