Validated intraclass correlation statistics to test item performance models.

A new method, with an application program in Matlab code, is proposed for testing item performance models on empirical databases. This method uses data intraclass correlation statistics as expected correlations to which one compares simple functions of correlations between model predictions and observed item performance. The method rests on a data population model whose validity for the considered data is suitably tested and has been verified for three behavioural measure databases. Contrarily to usual model selection criteria, this method provides an effective way of testing under-fitting and over-fitting, answering the usually neglected question "does this model suitably account for these data?"

Bayesian hypothesis testing for psychologists: a tutorial on the Savage-Dickey method.

In the field of cognitive psychology, the p-value hypothesis test has established a stranglehold on statistical reporting. This is unfortunate, as the p-value provides at best a rough estimate of the evidence that the data provide for the presence of an experimental effect. An alternative and arguably more appropriate measure of evidence is conveyed by a Bayesian hypothesis test, which prefers the model with the highest average likelihood. One of the main problems with this Bayesian hypothesis test, however, is that it often requires relatively sophisticated numerical methods for its computation. Here we draw attention to the Savage-Dickey density ratio method, a method that can be used to compute the result of a Bayesian hypothesis test for nested models and under certain plausible restrictions on the parameter priors. Practical examples demonstrate the method's validity, generality, and flexibility.

Estimation approaches in cognitive diagnosis modeling when attributes are hierarchically structured.

BACKGROUND: Although research in cognitive psychology suggests refraining from investigating cognitive skills inisolation, many cognitive diagnosis model (CDM) examples do not take hierarchical attribute structures into account. When hierarchical relationships among the attributes are not considered, CDM estimates may be biased. METHOD: The current study, through simulation and real data analyses, examines the impact of different MMLE-EM approaches on the item and person parameter estimates of the G-DINA, DINA and DINO models when attributes have a hierarchical structure. A number of estimation approaches that can result from modifying either the Q-matrix or prior distribution are proposed. Impact of the proposed approaches on item parameter estimation accuracy and attribute classification are investigated. RESULTS: For the G-DINA model estimation, the Q-matrix type (i.e, explicit vs. implicit) has greater impact than structuring the prior distribution. Specifically, explicit Q-matrices result in better item parameter recovery and higher correct classification rates. In contrast, structuring the prior distribution is more influential on item and person parameter estimates for the reduced models. When prior distribution is structured, the Q-matrix type has almost no influence on item and person parameter estimates of the DINA and DINO models. CONCLUSION: We can conclude that the Q-matrix type has a significant impact on CDM estimation, especially when the estimating model is G-DINA.

What happened to cognitive science?

More than a half-century ago, the 'cognitive revolution', with the influential tenet 'cognition is computation', launched the investigation of the mind through a multidisciplinary endeavour called cognitive science. Despite significant diversity of views regarding its definition and intended scope, this new science, explicitly named in the singular, was meant to have a cohesive subject matter, complementary methods and integrated theories. Multiple signs, however, suggest that over time the prospect of an integrated cohesive science has not materialized. Here we investigate the status of the field in a data-informed manner, focusing on four indicators, two bibliometric and two socio-institutional. These indicators consistently show that the devised multi-disciplinary program failed to transition to a mature inter-disciplinary coherent field. Bibliometrically, the field has been largely subsumed by (cognitive) psychology, and educationally, it exhibits a striking lack of curricular consensus, raising questions about the future of the cognitive science enterprise.

Children's knowledge of the earth: a new methodological and statistical approach.

In the field of children's knowledge of the earth, much debate has concerned the question of whether children's naive knowledge-that is, their knowledge before they acquire the standard scientific theory-is coherent (i.e., theory-like) or fragmented. We conducted two studies with large samples (N=328 and N=381) using a new paper-and-pencil test, denoted the EARTH (EArth Representation Test for cHildren), to discriminate between these two alternatives. We performed latent class analyses on the responses to the EARTH to test mental models associated with these alternatives. The naive mental models, as formulated by Vosniadou and Brewer, were not supported by the results. The results indicated that children's knowledge of the earth becomes more consistent as children grow older. These findings support the view that children's naive knowledge is fragmented.

Internet cognitive testing of large samples needed in genetic research.

Quantitative and molecular genetic research requires large samples to provide adequate statistical power, but it is expensive to test large samples in person, especially when the participants are widely distributed geographically. Increasing access to inexpensive and fast Internet connections makes it possible to test large samples efficiently and economically online. Reliability and validity of Internet testing for cognitive ability have not been previously reported; these issues are especially pertinent for testing children. We developed Internet versions of reading, language, mathematics and general cognitive ability tests and investigated their reliability and validity for 10- and 12-year-old children. We tested online more than 2500 pairs of 10-year-old twins and compared their scores to similar internet-based measures administered online to a subsample of the children when they were 12 years old (> 759 pairs). Within 3 months of the online testing at 12 years, we administered standard paper and pencil versions of the reading and mathematics tests in person to 30 children (15 pairs of twins). Scores on Internet-based measures at 10 and 12 years correlated .63 on average across the two years, suggesting substantial stability and high reliability. Correlations of about .80 between Internet measures and in-person testing suggest excellent validity. In addition, the comparison of the internet-based measures to ratings from teachers based on criteria from the UK National Curriculum suggests good concurrent validity for these tests. We conclude that Internet testing can be reliable and valid for collecting cognitive test data on large samples even for children as young as 10 years.

The representation of women in cognition.

This discussion expresses concerns raised by the representation of women authors in a recent special issue of Cognition dedicated to future trends. Its broader goal is to increase sensitivity to the contributions of female scientists within major journals across psychological science.

Estimation approaches in cognitive diagnosis modeling when attributes are hierarchically structured / Enfoques de estimación en Modelado Diagnóstico Cognitivo cuando los atributos están estructurados jerárquicamente

BACKGROUND: Although research in cognitive psychology suggests refraining from investigating cognitive skills inisolation, many cognitive diagnosis model (CDM) examples do not take hierarchical attribute structures into account. When hierarchical relationships among the attributes are not considered, CDM estimates may be biased. METHOD: The current study, through simulation and real data analyses, examines the impact of different MMLE-EM approaches on the item and person parameter estimates of the G-DINA, DINA and DINO models when attributes have a hierarchical structure. A number of estimation approaches that can result from modifying either the Q-matrix or prior distribution are proposed. Impact of the proposed approaches on item parameter estimation accuracy and attribute classification are investigated. RESULTS: For the G-DINA model estimation, the Q-matrix type (i.e, explicit vs. implicit) has greater impact than structuring the prior distribution. Specifically, explicit Q-matrices result in better item parameter recovery and higher correct classification rates. In contrast, structuring the prior distribution is more influential on item and person parameter estimates for the reduced models. When prior distribution is structured, the Q-matrix type has almost no influence on item and person parameter estimates of the DINA and DINO models. CONCLUSION: We can conclude that the Q-matrix type has a significant impact on CDM estimation, especially when the estimating model is G-DINA

ANTECEDENTES: a pesar de que investigación en psicología cognitiva sugiere abstenerse de investigar rasgos cognitivos de forma aislada, muchos de los ejemplos en Modelado Diagnóstico Cognitivo (MDC) no tienen en cuenta la estructura jerárquica de los atributos implicados. Sin embargo, las estimaciones que se hagan con los MDC pueden estar sesgadas cuando no se consideran estas relaciones jerárquicas. MÉTODO: a través de la simulación y datos reales, el presente estudio estudia el impacto de diferentes enfoques MMLE-EM en los parámetros estimados para los ítems y las personas según los modelos G-DINA, DINA y DINO cuando los atributos tienen una estructura jerárquica. Se proponen una serie de enfoques de estimación que resultan de modificar la Matriz-Q o la distribución previa. Se investiga el impacto de los enfoques propuestos en la precisión en la estimación de los parámetros de los ítems y la clasificación de atributos. RESULTADO: para la estimación del modelo G-DINA, el tipo de Matriz-Q (es decir, explícita vs. implícita) tiene un impacto mayor al de que la distribución previa esté estructurada. Por el contrario, una distribución previa estructurada influye más sobre la estimación de los parámetros de los ítems y las personas en el caso de los modelos reducidos. CONCLUSIÓN: podemos concluir que el tipo de Matriz-Q tiene un impacto significativo en la estimación de MDC, especialmente en el modelo G-DINA

Toward a method of selecting among computational models of cognition.

The question of how one should decide among competing explanations of data is at the heart of the scientific enterprise. Computational models of cognition are increasingly being advanced as explanations of behavior. The success of this line of inquiry depends on the development of robust methods to guide the evaluation and selection of these models. This article introduces a method of selecting among mathematical models of cognition known as minimum description length, which provides an intuitive and theoretically well-grounded understanding of why one model should be chosen. A central but elusive concept in model selection, complexity, can also be derived with the method. The adequacy of the method is demonstrated in 3 areas of cognitive modeling: psychophysics, information integration, and categorization.

Cognitive emissions of 1/f noise.

The residual fluctuations that naturally arise in experimental inquiry are analyzed in terms of their time histories. Although these fluctuations are generally relegated to a statistical purgatory known as unexplained variance, this article shows that they may harbor a long-term memory process known as 1/f noise. This type of noise has been encountered in a number of biological and physical systems and is theorized to be a signature of dynamic complexity. Its presence in psychological data appears to be associated with the most elementary aspect of cognitive process, the formation of representations.

The Children's Cognitive Triad Inventory: reliability, validity, and congruence with Beck's cognitive triad theory of depression.

Depression, once thought rare in children, is now more widely recognized and believed to arise from negative views of self, world, and future, according to Beck's cognitive theory of depression. The Cognitive Triad Inventory for children measures the three negative views, and although reported as psychometrically adequate, this study extended previous analyses with confirmatory factor analysis in a sample of 122 school-aged children. Internal consistency was .82 (total scale) but ranged from .54 to .76 for subscales reflecting the views of self, world, and future. Confirmatory factor analysis revealed factors reflecting three aspects of the self rather than the three negative views. The findings suggest that Beck's theory about the negative cognitive triad may be less suitable for children than adults.

The decade 1989-1998 in Spanish psychology: an analysis of research in basic psychological processes, history of psychology, and other related topics.

This article presents a review of research published by Spanish Faculty from the area of basic psychology in the decade 1989-1998. It provides information about research on basic psychological processes commonly studied under the labels of experimental and cognitive psychology, plus a number of topics from other research areas, including some applied psychology issues. The review analyzes the work of 241 faculty members from 27 different Spanish universities, as reflected in 1,882 published papers, book chapters, and books. The analyses carried out in this report include a description of the main research trends found in each area, with some representative references of the published materials, and statistics showing the distribution of this research work in various relevant publications (both Spanish and foreign), with figures that reveal the impact of this work both at a national and international scale.

Relaciones asimétricas entre atribuciones y afecto en el trabajo / Asymmetric relationships between attributions and affect in the workplace

En la presente investigación se estudia el afecto generado por las valoraciones cognitivas de los trabajadores sobre los eventos laborales. En esta relación se evalúan dos moderadores, la importancia atribuida a los eventos y el estilo explicativo del trabajador. Setenta y tres trabajadores contestaron un cuestionario de estilos explicativos (nivel inter-sujeto) y un cuestionario diario durante 10 días (nivel intra-sujeto) sobre la valoración cognitiva de eventos y el afecto asociado (N = 730 observaciones). Los resultados del análisis multinivel indican que la influencia de los moderadores en la relación valoración cognitiva-afecto es asimétrica para el afecto positivo y negativo. A nivel intra-sujeto hay una moderación de la importancia atribuida a los sucesos laborales en el afecto negativo, pero no en el positivo. En la misma línea, pero con una influencia inter-nivel, el estilo explicativo tiene efecto moderador para el afecto negativo cuando la importancia es atribuida al evento; pero no así para el afecto positivo. Este estudio aporta elementos para el estudio multinivel de terceras variables en la dinámica diaria de la valoración cognitiva de eventos laborales y del afecto (AU)

The present study focuses on the affect generated by cognitive appraisals of work events in workers' daily life. In this relationship, two moderators have been tested, relevance of the event and explanatory style. Seventy-three workers answered an attributional style questionnaire once (between-level data) and also a daily questionnaire (within-level data) about work events and affect for ten days (N = 730 observations).Multilevel analysis results showed that the influence of moderators in the relationship of appraisal-affect is asymmetric for positive and negative affect. At within-level there is a moderation of the importance attributed to the event for negative affect, but not for positive affect. In the same line, but in an inter-level relationship, the explanatory style has a moderator effect for negative affect when the event is appraised as important. Nevertheless, such an influence is not found for positive affect. The study provides new elements for a multilevel study of third variables in the daily dynamics of appraisal and affect (AU)

Ignoring facial emotion expressions does not eliminate their influence on cooperation decisions / Ignorar las emociones de otros no evita su efecto en nuestras decisiones cooperativas

Whereas the automaticity of emotion processing has been investigated in several cognitive domains, its mandatory influence on cooperative decision-making is still unexplored. We employed an interference-task to evaluate whether explicit instructions to ignore the emotions of others during alleged interpersonal interactions override their behavioral effects. Participants played a Trust Game multiple times with eight cooperative or non-cooperative partners, who displayed facial expressions of happiness or anger. Emotions were non-predictive regarding the partners’ cooperation. In Experiments 1 and 2 participants were explicitly asked to ignore the emotions, and the uncertainty about the partners’ behavior varied. We found an effect of emotional interference; whereas happy partners speeded cooperative decisions, angry ones speeded non-cooperative choices. This was replicated in Experiment 3, where the request of ignoring emotions was removed. Our results show the inevitable influence of the emotional displays of others during cooperation decisions, which fits with theories that contend for a tight link between emotions and social context (AU)

Pese a que la influencia ejercida por el procesamiento de las emociones ha sido estudiada en diferentes dominios cognitivos, el papel de estas durante la toma decisiones en contextos sociales queda aún por explorar. Utilizamos una tarea de interferencia con el fin de estudiar en qué grado es posible evitar la influencia de las emociones de otras personas cuando nos encontramos en interacción con ellas. Los participantes jugaron, en múltiples rondas, al Juego de la Confianza con ocho compañeros que podían ser de tipo cooperativo o no cooperativo, y cuya expresión facial podía ser de felicidad o de enfado. Las emociones de los compañeros de juego no eran predictivas, en ningún caso, de su grado de cooperación. Tanto en el Experimento 1 como en el Experimento 2 los participantes fueron instruidos de manera explícita que debían ignorar las expresiones emocionales de sus compañeros. La validez de la información personal (el grado de cooperación) fue manipulada entre ambos expresultados revelaron un efecto de interferencia emocional; las expresiones de felicidad redujeron el tiempo necesario para tomar la decisión de cooperación, mientras que las expresiones de enfado acortaron las decisiones de no cooperación. Este efecto de interferencia fue replicado en el Experimento 3, en el que la instrucción explícita de ignorar las emociones de los compañeros había sido eliminada.Nuestros resultados muestran que las emociones de otros nos influyen de manera inevitable durante nuestra interacción con ellos. Esta evidencia es coherente con las teorías que defienden la existencia de un estrecho vínculo entre emociones y contexto social (AU)

Cognitive neuroscience of creativity: EEG based approaches.

Cognitive neuroscience of creativity has been extensively studied using non-invasive electrical recordings from the scalp called electroencephalograms (EEGs) and event related potentials (ERPs). The paper discusses major aspects of performing research using EEG/ERP based experiments including the recording of the signals, removing noise, estimating ERP signals, and signal analysis for better understanding of the neural correlates of processes involved in creativity. Important factors to be kept in mind to record clean EEG signal in creativity research are discussed. The recorded EEG signal can be corrupted by various sources of noise and methodologies to handle the presence of unwanted artifacts and filtering noise are presented followed by methods to estimate ERPs from the EEG signals from multiple trials. The EEG and ERP signals are further analyzed using various techniques including spectral analysis, coherence analysis, and non-linear signal analysis. These analysis techniques provide a way to understand the spatial activations and temporal development of large scale electrical activity in the brain during creative tasks. The use of this methodology will further enhance our understanding the processes neural and cognitive processes involved in creativity.

Creative or created: using anecdotes to investigate animal cognition.

In non-human animals, creative behaviour occurs spontaneously only at low frequencies, so is typically missed by standardised observational methods. Experimental approaches have tended to rely overly on paradigms from child development or adult human cognition, which may be inappropriate for species that inhabit very different perceptual worlds and possess quite different motor capacities than humans. The analysis of anecdotes offers a solution to this impasse, provided certain conditions are met. To be reliable, anecdotes must be recorded immediately after observation, and only the records of scientists experienced with the species and the individuals concerned should be used. Even then, interpretation of a single record is always ambiguous, and analysis is feasible only when collation of multiple records shows that a behaviour pattern occurs repeatedly under similar circumstances. This approach has been used successfully to study a number of creative capacities of animals: the distribution, nature and neural correlates of deception across the primate order; the occurrence of teaching in animals; and the neural correlates of several aptitudes--in birds, foraging innovation, and in primates, innovation, social learning and tool-use. Drawing on these approaches, we describe the use of this method to investigate a new problem, the cognition of the African elephant, a species whose sheer size and evolutionary distance from humans renders the conventional methods of comparative psychology of little use. The aim is both to chart the creative cognitive capacities of this species, and to devise appropriate experimental methods to confirm and extend previous findings.

Test modificado de clasificación de tarjetas de Wisconsin: normalización y estandarización de la prueba en población española / Modified Wisconsin Card Sorting Test: standardization and norms of the test for a population sample in Spain

Introducción. El test modificado de clasificación de tarjetas de Wisconsin (M-WCST) es una versión breve y modificada del WCST que evalúa las funciones ejecutivas y la flexibilidad mental. Presenta algunas diferencias y ventajas respecto a otras versiones del WCST que se han descrito en la bibliografía. Objetivo. Estandarizar y desarrollar datos normativos calibrados demográficamente para el M-WCST en una muestra representativa de la población española. Sujetos y métodos. Como parte del proyecto multicéntrico Normacog, se administró el M-WCST a 700 participantes (rango: 18-90 años). Se analizaron el efecto de la edad, el nivel educativo y el sexo sobre el M-WCST, y se crearon percentiles y puntuaciones escalares calibradas demográficamente para cada puntuación directa. Resultados. Se observó un efecto significativo de la edad y del nivel educativo sobre las variables analizadas del M-WCST (categorías correctas, errores perseverativos y errores totales), pero no un efecto significativo del sexo en ninguna de las variables. La edad y la educación explicaban un 5,0-21,2% de la varianza en el M-WCST y mostraron que, a mayor edad y menor nivel de educación formal, el número de categorías correctas disminuía y se cometían mayor cantidad de errores. Conclusión. El presente estudio aporta por primera vez los baremos normativos del M-WCST para la población española teniendo en cuenta las características sociodemográficas de nuestra sociedad. Se confirma la influencia de la edad y el nivel educativo sobre el rendimiento del M-WCST (AU)

Introduction. The Modified Wisconsin Card Sorting Test (M-WCST) is a shorter, modified version of the WCST that assesses executive functioning and mental flexibility. The M-WCST presents some differences and advantages compared to other versions of the WCST, as previously described in the scientific literature. Aim. To standardize and develop demographically-calibrated norms for the M-WCST in a sample representing of the population of Spain. Subjects and methods. This study is part of the multisite Normacog project. Seven hundred participants from 18 to 90 years old were assessed using the M-WCST. The effects of age, sex, and educational level on M-WCST performance were analyzed, and demographically-calibrated percentiles and scaled scores corresponding to each raw score were created. Results. The effect of age and level of education on the M-WCST variables analyzed (correct categories, perseverative errors and total errors) was statistically significant, whereas sex was not significant. Age and education explained 5.0-21.2% of the variance in M-WCST performance. Older participants with lower level of formal education completed fewer category sorts and made more errors than younger and more educated participants. Conclusion. This study reports the first normative data for the M-WCST in a contemporary Spanish sample, taking sociodemographic characteristics of the population into account. The influence of age and level of education on the M-WCST performance was confirmed (AU)

¿Cómo afecta la privación de sueño durante una guardia de 24 horas las funciones cognitivas de los residentes de ortopedia y traumatología? / How does sleep deprivation during 24 hours on call duty affect the cognitive performance orthopaedic residents?

Introducción. La falta de sueño suele presentarse regularmente en los residentes de especialidades médicas durante su proceso de formación. El objetivo principal de nuestro estudio fue comparar las funciones cognitivas basales y después de la privación de sueño posguardia en residentes de ortopedia y traumatología. Material y métodos. Se han incluido en el estudio a residentes de ortopedia y traumatología y se evaluaron la atención y funciones cognitivas a través de los siguientes test: Continuous Performance Test (CPT 2), Digit Spam Directo e Inverso (Versión 5), Fluencia Fonológica de 1 letra y Pasat Test. Todas las evaluaciones basales se realizaron después de un periodo de descanso en domicilio de al menos 6 h y las evaluaciones posguardia fueron realizadas en residentes con menos de 3 h de sueño. Resultados. Diecinueve residentes fueron incluidos en el estudio. La edad media de la serie fue de 27 ± 1,89 años y 15 eran de sexo masculino. El promedio de horas de sueño basal fue de 6,5 h (rango 6-8) y posguardia de 1,5 h (rango 0,5-3). En la evaluación de CPT2 se han encontrado diferencias significativas en el número de aciertos (p = 0,007), número de omisiones (p = 0,004) y perseveraciones (p = 0,036) a la consigna planteada. No hemos encontrado diferencias significativas en los otros test. Conclusión. La falta del sueño posterior a una guardia de 24 h de ortopedia y traumatología afecta la atención de los residentes, aumentando el número de errores y omisiones (AU)

Introduction. Sleep deprivation is usually present in residents during their training program. The purpose of our study was to analyze the cognitive performance of a group of orthopaedic residents before and after 24 hours on call duty. Methods. We include orthopaedic residents and their cognitive functions were evaluated by the following tests: Continuous Performance Test (CPT 2), Digit Spam (Versión 5), 1 letter Fonologic Fluence y Pasat Test. All the tests were done after a sleeping period at home of at least 6 hours and after being on call (sleeping less than 3 hours). Results. Nineteen residents were included in the study. The median age was 27 ± 1.89 and 15 were male. The mean hours of sleeping at home was 6.5 (range 6-8) and after on call duty was 1.5 (range 0.5-3). Statistical difference were found in CPT 2 test en terms of correct answers (p=0.007), omissions (p=0.004) and perseverations (p=0.036). No significant differences were found in the other tests. Conclusion. Sleep deprivation after 24 hours on call duty affects cognitive performance of orthopaedic residents, increasing the number of errors and omissions (AU)

Development of an instrument to assess cognitive processes in physical education classes.

Using the mediating process paradigm (Doyle, 1977) as a framework, the need to develop reliable and valid instruments for assessing cognitive processes is apparent, and that was the purpose of this study. Participants (N = 819) completed the Cognitive Processes Questionnaire in Physical Education (CPQPE), as well as three other instruments addressing dispositional goal orientation, perception of motivational climate, and beliefs about causes of success in physical education. The five-factor structure that emerged in an exploratory factor analysis produced an acceptable fit with the data in the confirmatory factor analysis. The subscales of the CPQPE were related to a task-involved goal perspective and the belief that success is attributed to motivation and effort. The results indicate the CPQPE is a valid and reliable instrument that can provide valuable information about the teaching and learning process.

Intuitive physics of collision effects on simulated spheres iffering in size, velocity, and material

This is an intuitive physics study of collision events. In two experiments the participants were presented with a simulated 3D scene showing one sphere moving horizontally towards another stationary sphere. The moving sphere stopped just before colliding with the stationary one. Participants were asked to rate the positions which both spheres would have reached after a fixed time if the collision had really occurred. The simulated masses of both spheres and the velocity of the moving one were manipulated. Specifically, in Experiment 1 different implied masses were defined by varying only the size of the spheres; in Experiment 2, different implied masses were defined by varying both the size and the apparent texture (material) of the spheres. Functional Measurement was used to compare the physical laws of collision events with cognitive integration rules. Cognitive rules proved to be more similar to physical laws in Experiment 2, i.e., when both spheres size and apparent texture were manipulated. Surprisingly, in both experiments only half the participants took into account the possibility that the moving sphere could have bounced back after the collision. These and other results are important for teaching elementary physics(AU)