Drawing as a means to characterize memory and cognition.

As psychological research embraces more naturalistic questions and large-scale analytic methods, drawing has emerged as an exciting tool for studying cognition. Drawing provides rich information about how we view the world, ranging from largely veridical perceptual representations to abstracted meta-cognitive representations. Drawing also requires the integration of multiple processes (e.g., vision, memory, motor learning), and experience with drawing can have an impact on such processes. As a result, drawing presents several interesting cognitive questions, while also providing a way to gain insight into a multitude of others. This Special Issue features 25 cutting-edge studies utilizing drawing to reveal discoveries transversing fields in psychology. These diverse studies investigate drawing across children, young adults, older adults, and special populations such as individuals with blindness, anterograde amnesia, apraxia, and semantic dementia. These studies detail new discoveries about the mechanisms underlying memory, attention, mathematical reasoning, and other cognitive processes. They employ a range of methods including psychophysical experiments, deep learning, and neuroimaging. Finally, many of these studies cover topics about the impact of drawing as a process on other cognitive processes, including how drawing expertise impacts other processes like visual memory or spatial abilities. Overall, this collection of studies paves the way for an exciting future of drawing as a commonplace tool used by psychologists to understand complex phenomena.

Using games to understand the mind.

Board, card or video games have been played by virtually every individual in the world. Games are popular because they are intuitive and fun. These distinctive qualities of games also make them ideal for studying the mind. By being intuitive, games provide a unique vantage point for understanding the inductive biases that support behaviour in more complex, ecological settings than traditional laboratory experiments. By being fun, games allow researchers to study new questions in cognition such as the meaning of 'play' and intrinsic motivation, while also supporting more extensive and diverse data collection by attracting many more participants. We describe the advantages and drawbacks of using games relative to standard laboratory-based experiments and lay out a set of recommendations on how to gain the most from using games to study cognition. We hope this Perspective will lead to a wider use of games as experimental paradigms, elevating the ecological validity, scale and robustness of research on the mind.

Parallel developmental changes in children's production and recognition of line drawings of visual concepts.

Childhood is marked by the rapid accumulation of knowledge and the prolific production of drawings. We conducted a systematic study of how children create and recognize line drawings of visual concepts. We recruited 2-10-year-olds to draw 48 categories via a kiosk at a children's museum, resulting in >37K drawings. We analyze changes in the category-diagnostic information in these drawings using vision algorithms and annotations of object parts. We find developmental gains in children's inclusion of category-diagnostic information that are not reducible to variation in visuomotor control or effort. Moreover, even unrecognizable drawings contain information about the animacy and size of the category children tried to draw. Using guessing games at the same kiosk, we find that children improve across childhood at recognizing each other's line drawings. This work leverages vision algorithms to characterize developmental changes in children's drawings and suggests that these changes reflect refinements in children's internal representations.

Creating ad hoc graphical representations of number.

The ability to communicate about exact number is critical to many modern human practices spanning science, industry, and politics. Although some early numeral systems used 1-to-1 correspondence (e.g., 'IIII' to represent 4), most systems provide compact representations via more arbitrary conventions (e.g., '7' and 'VII'). When people are unable to rely on conventional numerals, however, what strategies do they initially use to communicate number? Across three experiments, participants used pictures to communicate about visual arrays of objects containing 1-16 items, either by producing freehand drawings or combining sets of visual tokens. We analyzed how the pictures they produced varied as a function of communicative need (Experiment 1), spatial regularities in the arrays (Experiment 2), and visual properties of tokens (Experiment 3). In Experiment 1, we found that participants often expressed number in the form of 1-to-1 representations, but sometimes also exploited the configuration of sets. In Experiment 2, this strategy of using configural cues was exaggerated when sets were especially large, and when the cues were predictably correlated with number. Finally, in Experiment 3, participants readily adopted salient numerical features of objects (e.g., four-leaf clover) and generally combined them in a cumulative-additive manner. Taken together, these findings corroborate historical evidence that humans exploit correlates of number in the external environment - such as shape, configural cues, or 1-to-1 correspondence - as the basis for innovating more abstract number representations.

Consistency and Variation in Reasoning About Physical Assembly.

The ability to reason about how things were made is a pervasive aspect of how humans make sense of physical objects. Such reasoning is useful for a range of everyday tasks, from assembling a piece of furniture to making a sandwich and knitting a sweater. What enables people to reason in this way even about novel objects, and how do people draw upon prior experience with an object to continually refine their understanding of how to create it? To explore these questions, we developed a virtual task environment to investigate how people come up with step-by-step procedures for recreating block towers whose composition was not readily apparent, and analyzed how the procedures they used to build them changed across repeated attempts. Specifically, participants (N = 105) viewed 2D silhouettes of eight unique block towers in a virtual environment simulating rigid-body physics, and aimed to reconstruct each one in less than 60 s. We found that people built each tower more accurately and quickly across repeated attempts, and that this improvement reflected both group-level convergence upon a tiny fraction of all possible viable procedures, as well as error-dependent updating across successive attempts by the same individual. Taken together, our study presents a scalable approach to measuring consistency and variation in how people infer solutions to physical assembly problems.

Developmental changes in drawing production under different memory demands in a U.S. and Chinese sample.

Children's drawings of common object categories become dramatically more recognizable across childhood. What are the major factors that drive developmental changes in children's drawings? To what degree are children's drawings a product of their changing internal category representations versus limited by their visuomotor abilities or their ability to recall the relevant visual information? To explore these questions, we examined the degree to which developmental changes in drawing recognizability vary across different drawing tasks that vary in memory demands (i.e., drawing from verbal vs. picture cues) and with children's shape-tracing abilities across two geographical locations (San Jose, United States, and Beijing, China). We collected digital shape tracings and drawings of common object categories (e.g., cat, airplane) from 4- to 9-year-olds (N = 253). The developmental trajectory of drawing recognizability was remarkably similar when children were asked to draw from pictures versus verbal cues and across these two geographical locations. In addition, our Beijing sample produced more recognizable drawings but showed similar tracing abilities to children from San Jose. Overall, this work suggests that the developmental trajectory of children's drawings is remarkably consistent and not easily explainable by changes in visuomotor control or working memory; instead, changes in children's drawings over development may at least partly reflect changes in the internal representations of object categories. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Socially intelligent machines that learn from humans and help humans learn.

A hallmark of human intelligence is the ability to understand and influence other minds. Humans engage in inferential social learning (ISL) by using commonsense psychology to learn from others and help others learn. Recent advances in artificial intelligence (AI) are raising new questions about the feasibility of human-machine interactions that support such powerful modes of social learning. Here, we envision what it means to develop socially intelligent machines that can learn, teach, and communicate in ways that are characteristic of ISL. Rather than machines that simply predict human behaviours or recapitulate superficial aspects of human sociality (e.g. smiling, imitating), we should aim to build machines that can learn from human inputs and generate outputs for humans by proactively considering human values, intentions and beliefs. While such machines can inspire next-generation AI systems that learn more effectively from humans (as learners) and even help humans acquire new knowledge (as teachers), achieving these goals will also require scientific studies of its counterpart: how humans reason about machine minds and behaviours. We close by discussing the need for closer collaborations between the AI/ML and cognitive science communities to advance a science of both natural and artificial intelligence. This article is part of a discussion meeting issue 'Cognitive artificial intelligence'.

Visual resemblance and interaction history jointly constrain pictorial meaning.

How do drawings-ranging from detailed illustrations to schematic diagrams-reliably convey meaning? Do viewers understand drawings based on how strongly they resemble an entity (i.e., as images) or based on socially mediated conventions (i.e., as symbols)? Here we evaluate a cognitive account of pictorial meaning in which visual and social information jointly support visual communication. Pairs of participants used drawings to repeatedly communicate the identity of a target object among multiple distractor objects. We manipulated social cues across three experiments and a full replication, finding that participants developed object-specific and interaction-specific strategies for communicating more efficiently over time, beyond what task practice or a resemblance-based account alone could explain. Leveraging model-based image analyses and crowdsourced annotations, we further determined that drawings did not drift toward "arbitrariness," as predicted by a pure convention-based account, but preserved visually diagnostic features. Taken together, these findings advance psychological theories of how successful graphical conventions emerge.

Outcomes of two different unbalanced segregations from a maternal t(4;10)(q33;p15.1) translocation.

BACKGROUND: Unbalanced translocations can cause developmental delay (DD), intellectual disability (ID), growth problems, dysmorphic features, and congenital anomalies. They may arise de novo or may be inherited from a parent carrying a balanced rearrangement. It is estimated that 1/500 people is a balanced translocation carrier. The outcomes of different chromosomal rearrangements have the potential to reveal the functional consequences of partial trisomy or partial monosomy and can help guide genetic counseling for balanced carriers, and other young patients diagnosed with similar imbalances. METHODS: We performed clinical phenotyping and cytogenetic analyses of two siblings with a history of developmental delay (DD), intellectual disability (ID) and dysmorphic features. RESULTS: The proband, a 38-year-old female, has a history of short stature, dysmorphic features and aortic coarctation. She underwent chromosomal microarray analysis, which identified partial monosomy of 4q and partial trisomy of 10p. Her brother, a 37-year-old male, has a history of more severe DD, behavioral problems, dysmorphic features, and congenital anomalies. Subsequently, karyotype confirmed two different unbalanced translocations in the siblings: 46,XX,der(4)t(4;10)(q33;p15.1) and 46,XY,der(10)t(4;10)(q33;p15.1), respectively. These chromosomal rearrangements represent two possible outcomes from a parent who is a carrier for a balanced translocation 46,XX,t(4;10)(q33;p15.1). CONCLUSION: To our knowledge, this 4q and 10p translocation has not been described in literature. In this report we compare clinical features due to the composite effects of partial monosomy 4q with partial trisomy 10p and partial trisomy 4q with partial monosomy 10p. These findings speak to the relevance of old and new genomic testing, the viability of these segregation outcomes, and need for genetic counseling.

Visual explanations prioritize functional properties at the expense of visual fidelity.

Visual explanations play an integral role in communicating mechanistic knowledge about how things work. What do people think distinguishes such pictures from those that are intended to convey how things look? To explore this question, we used a drawing paradigm to elicit both visual explanations and depictions of novel machine-like objects, then conducted a detailed analysis of the semantic information conveyed in each drawing. We found that visual explanations placed greater emphasis on parts of the machines that move or interact to produce an effect, while visual depictions emphasized parts that were visually salient, even if they were static. Moreover, we found that these differences in visual emphasis impacted what information naive viewers could extract from these drawings: explanations made it easier to infer which action was needed to operate the machine, but more difficult to identify which machine it represented. Taken together, our findings suggest that people spontaneously prioritize functional information when producing visual explanations but that this strategy may be double-edged, facilitating inferences about physical mechanism at the expense of preserving visual fidelity.