Online webcam-based eye tracking in cognitive science: A first look.

Online experimentation is emerging in many areas of cognitive psychology as a viable alternative or supplement to classical in-lab experimentation. While performance- and reaction-time-based paradigms are covered in recent studies, one instrument of cognitive psychology has not received much attention up to now: eye tracking. In this study, we used JavaScript-based eye tracking algorithms recently made available by Papoutsaki et al. (International Joint Conference on Artificial Intelligence, 2016) together with consumer-grade webcams to investigate the potential of online eye tracking to benefit from the common advantages of online data conduction. We compared three in-lab conducted tasks (fixation, pursuit, and free viewing) with online-acquired data to analyze the spatial precision in the first two, and replicability of well-known gazing patterns in the third task. Our results indicate that in-lab data exhibit an offset of about 172 px (15% of screen size, 3.94° visual angle) in the fixation task, while online data is slightly less accurate (18% of screen size, 207 px), and shows higher variance. The same results were found for the pursuit task with a constant offset during the stimulus movement (211 px in-lab, 216 px online). In the free-viewing task, we were able to replicate the high attention attribution to eyes (28.25%) compared to other key regions like the nose (9.71%) and mouth (4.00%). Overall, we found web technology-based eye tracking to be suitable for all three tasks and are confident that the required hard- and software will be improved continuously for even more sophisticated experimental paradigms in all of cognitive psychology.

Simplifying the interaction between cognitive models and task environments with the JSON Network Interface.

Process models of cognition, written in architectures such as ACT-R and EPIC, should be able to interact with the same software with which human subjects interact. By eliminating the need to simulate the experiment, this approach would simplify the modeler's effort, while ensuring that all steps required of the human are also required by the model. In practice, the difficulties of allowing one software system to interact with another present a significant barrier to any modeler who is not also skilled at this type of programming. The barrier increases if the programming language used by the modeling software differs from that used by the experimental software. The JSON Network Interface simplifies this problem for ACT-R modelers, and potentially, modelers using other systems.

The cognitive science of visual-spatial displays: implications for design.

This paper reviews cognitive science perspectives on the design of visual-spatial displays and introduces the other papers in this topic. It begins by classifying different types of visual-spatial displays, followed by a discussion of ways in which visual-spatial displays augment cognition and an overview of the perceptual and cognitive processes involved in using displays. The paper then argues for the importance of cognitive science methods to the design of visual displays and reviews some of the main principles of display design that have emerged from these approaches to date. Cognitive scientists have had good success in characterizing the performance of well-defined tasks with relatively simple visual displays, but many challenges remain in understanding the use of complex displays for ill-defined tasks. Current research exemplified by the papers in this topic extends empirical approaches to new displays and domains, informs the development of general principles of graphic design, and addresses current challenges in display design raised by the recent explosion in availability of complex data sets and new technologies for visualizing and interacting with these data.

CogSketch: sketch understanding for cognitive science research and for education.

Sketching is a powerful means of working out and communicating ideas. Sketch understanding involves a combination of visual, spatial, and conceptual knowledge and reasoning, which makes it both challenging to model and potentially illuminating for cognitive science. This paper describes CogSketch, an ongoing effort of the NSF-funded Spatial Intelligence and Learning Center, which is being developed both as a research instrument for cognitive science and as a platform for sketch-based educational software. We describe the idea of open-domain sketch understanding, the scientific hypotheses underlying CogSketch, and provide an overview of the models it employs, illustrated by simulation studies and ongoing experiments in creating sketch-based educational software.

The iCub humanoid robot: an open-systems platform for research in cognitive development.

We describe a humanoid robot platform--the iCub--which was designed to support collaborative research in cognitive development through autonomous exploration and social interaction. The motivation for this effort is the conviction that significantly greater impact can be leveraged by adopting an open systems policy for software and hardware development. This creates the need for a robust humanoid robot that offers rich perceptuo-motor capabilities with many degrees of freedom, a cognitive capacity for learning and development, a software architecture that encourages reuse & easy integration, and a support infrastructure that fosters collaboration and sharing of resources. The iCub satisfies all of these needs in the guise of an open-system platform which is freely available and which has attracted a growing community of users and developers. To date, twenty iCubs each comprising approximately 5000 mechanical and electrical parts have been delivered to several research labs in Europe and to one in the USA.

A cognitive neuroscience-based computerized battery for efficient measurement of individual differences: standardization and initial construct validation.

There is increased need for efficient computerized methods to collect reliable data on a range of cognitive domains that can be linked to specific brain systems. Such need arises in functional neuroimaging studies, where individual differences in cognitive performance are variables of interest or serve as confounds. In genetic studies of complex behavior, which require particularly large samples, such trait measures can serve as endophenotypes. Traditional neuropsychological tests, based on clinical pathological correlations, are protracted, require extensive training in administration and scoring, and leave lengthy paper trails (double-entry for analysis). We present a computerized battery that takes an average of 1h and provides measures of accuracy and speed on 9 neurocognitive domains. They are cognitive neuroscience-based in that they have been linked experimentally to specific brain systems with functional neuroimaging studies. We describe the process of translating tasks used in functional neuroimaging to tests for assessing individual differences. Data are presented on each test with samples ranging from 139 (81 female) to 536 (311 female) of carefully screened healthy individuals ranging in age from 18 to 84. Item consistency was established with acceptable to high Cronbach alpha coefficients. Inter-item correlations were moderate to high within domain and low to nil across domains, indicating construct validity. Initial criterion validity was demonstrated by sensitivity to sex differences and the effects of age, education and parental education. These results encourage the use of this battery in studies needing an efficient assessment of major neurocognitive domains such as multi-site genetic studies and clinical trials.

Cognitive simulators for medical education and training.

Simulators for honing procedural skills (such as surgical skills and central venous catheter placement) have proven to be valuable tools for medical educators and students. While such simulations represent an effective paradigm in surgical education, there is an opportunity to add a layer of cognitive exercises to these basic simulations that can facilitate robust skill learning in residents. This paper describes a controlled methodology, inspired by neuropsychological assessment tasks and embodied cognition, to develop cognitive simulators for laparoscopic surgery. These simulators provide psychomotor skill training and offer the additional challenge of accomplishing cognitive tasks in realistic environments. A generic framework for design, development and evaluation of such simulators is described. The presented framework is generalizable and can be applied to different task domains. It is independent of the types of sensors, simulation environment and feedback mechanisms that the simulators use. A proof of concept of the framework is provided through developing a simulator that includes cognitive variations to a basic psychomotor task. The results of two pilot studies are presented that show the validity of the methodology in providing an effective evaluation and learning environments for surgeons.

Maze Suite 1.0: a complete set of tools to prepare, present, and analyze navigational and spatial cognitive neuroscience experiments.

Maze Suite is a complete set of tools that enables researchers to perform spatial and navigational behavioral experiments within interactive, easy-to-create, and extendable (e.g., multiple rooms) 3-D virtual environments. Maze Suite can be used to design and edit adapted 3-D environments, as well as to track subjects' behavioral performance. Maze Suite consists of three main applications: an editing program for constructing maze environments (MazeMaker), a visualization/rendering module (MazeWalker), and an analysis and mapping tool (MazeViewer). Each of these tools is run and used from a graphical user interface, thus making editing, execution, and analysis user friendly. MazeMaker is a .NET architecture application that can easily be used to create new 3-D environments and to edit objects (e.g., geometric shapes, pictures, landscapes, etc.) or add them to the environment effortlessly. In addition, Maze Suite has the capability of sending signal-out pulses to physiological recording devices, using standard computer ports. Maze Suite, with all three applications, is a unique and complete toolset for researchers who want to easily and rapidly deploy interactive 3-D environments.

Cognitive neuroimaging: cognitive science out of the armchair.

Cognitive scientists were not quick to embrace the functional neuroimaging technologies that emerged during the late 20th century. In this new century, cognitive scientists continue to question, not unreasonably, the relevance of functional neuroimaging investigations that fail to address questions of interest to cognitive science. However, some ultra-cognitive scientists assert that these experiments can never be of relevance to the study of cognition. Their reasoning reflects an adherence to a functionalist philosophy that arbitrarily and purposefully distinguishes mental information-processing systems from brain or brain-like operations. This article addresses whether data from properly conducted functional neuroimaging studies can inform and subsequently constrain the assumptions of theoretical cognitive models. The article commences with a focus upon the functionalist philosophy espoused by the ultra-cognitive scientists, contrasting it with the materialist philosophy that motivates both cognitive neuroimaging investigations and connectionist modelling of cognitive systems. Connectionism and cognitive neuroimaging share many features, including an emphasis on unified cognitive and neural models of systems that combine localist and distributed representations. The utility of designing cognitive neuroimaging studies to test (primarily) connectionist models of cognitive phenomena is illustrated using data from functional magnetic resonance imaging (fMRI) investigations of language production and episodic memory.

Was Babbage's Analytical Engine intended to be a mechanical model of the mind?

In the 1830s, Charles Babbage worked on a mechanical computer he dubbed the Analytical Engine. Although some people around Babbage described his invention as though it had authentic mental powers, Babbage refrained from making such claims. He does not, however, seem to have discouraged those he worked with from mooting the idea publicly. This article investigates whether (1) the Analytical Engine was the focus of a covert research program into the mechanism of mentality; (2) Babbage opposed the idea that the Analytical Engine had mental powers but allowed his colleagues to speculate as they saw fit; or (3) Babbage believed such claims to be fanciful, but cleverly used the publicity they engendered to draw public and political attention to his project.

Semantic distance norms computed from an electronic dictionary (WordNet).

WordNet, an electronic dictionary (or lexical database), is a valuable resource for computational and cognitive scientists. Recent work on the computing of semantic distances among nodes (synsets) in WordNet has made it possible to build a large database of semantic distances for use in selecting word pairs for psychological research. The database now contains nearly 50,000 pairs of words that have values for semantic distance, associative strength, and similarity based on co-occurrence. Semantic distance was found to correlate weakly with these other measures but to correlate more strongly with another measure of semantic relatedness, featural similarity. Hierarchical clustering analysis suggested that the knowledge structure underlying semantic distance is similar in gross form to that underlying featural similarity. In experiments in which semantic similarity ratings were used, human participants were able to discriminate semantic distance. Thus, semantic distance as derived from WordNet appears distinct from other measures of word pair relatedness and is psychologically functional. This database may be downloaded from www.psychonomic.org/archive/.

The PC tachistoscope has 240 pages.

Myors (1998) showed how to combine familiar video page switching with bit-plane layering in video mode 0dh to increase the capacity of the PC tachistoscope from 8 to 32 pages. The present article shows how to combine video page switching with color page switching to implement a 240-page tachistoscope, thus producing an almost eightfold increase in the capacity of the PC tachistoscope. The main limitation of this technique is that the images cannot all be located in the same position on the screen. Complete source code in C is included.

Cognitive neurotoxicology: a luxury or necessity?

Impaired psychological test performance is often observed at concentrations of a neurotoxicant below those producing harmful effects on other organ systems. The importance of this distinctive susceptibility lies in the opportunity it provides for the early detection of dysfunction. From this perspective, it is essential to evolve sensitive psychological methods for studying these states of marginal toxicity. It is argued that a cognitive approach provides the necessary degree of sensitivity and specificity for characterizing these states. Given the growing interest in using cognitive models to assess minor dysfunction in areas outside neurotoxicology, it is further argued that theoretically motivated methods can no longer be considered a luxury for neurotoxicological work. It is concluded that there are at least two advantages to this approach. First, it provides a theoretical framework for organising data. Second, establishing and developing links to substantive areas of cognitive investigation outside neurotoxicology will allow cross-fertilization to occur on a scientific level and provide a more convincing basis for action on a regulatory level.

The Automated Cognitive Test (ACT) system.

The ACT system is a key-press, menu-driven system for selecting, administering, and storing raw data from a series of specially designed psychological tasks. Associated task analysis programs process the raw data and store the resulting summary data for later statistical analysis. The system utilizes a cognitive approach to assessments of marginal toxicity by employing multiple performance parameters to specify a profile of deficits that, on the basis of a task's internal structure, can be related to functionally discrete cognitive systems. The tasks have been developed from a consideration of current cognitive theory and the areas of cognition include those of learning, memory, attention, reasoning, verbal, and spatial abilities. The ACT system is described in terms of its four major components: the cognitive tasks, the stimulus materials, the analysis methods, and the process of saving and combining summary data into files suitable for transfer to statistical analysis programs. The system thus automates the data collection to statistical analysis process.