Effects of Iconicity in Recognition Memory.

Iconicity refers to a resemblance between word form and meaning. Previous work has shown that iconic words are learned earlier and processed faster. Here, we examined whether iconic words are recognized better on a recognition memory task. We also manipulated the level at which items were encoded-with a focus on either their meaning or their form-in order to gain insight into the mechanism by which iconicity would affect memory. In comparison with non-iconic words, iconic words were associated with a higher false alarm rate, a lower d' score, and a lower response criterion in Experiment 1. We did not observe any interaction between iconicity and encoding condition. To test the generalizability of these findings, we examined effects of iconicity in a recognition memory megastudy across 3880 items. After controlling for a variety of lexical and semantic variables, iconicity was predictive of more hits and false alarms, and a lower response criterion in this dataset. In Experiment 2, we examined whether these effects were due to increased feelings of familiarity for iconic items by including a familiar versus recollect decision. This experiment replicated the overall results of Experiment 1 and found that participants were more likely to categorize words that they had seen before as familiar (vs. recollected) if they were iconic. Together, these results demonstrate that iconicity has an effect on memory. We discuss implications for theories of iconicity.

The maluma/takete effect is late: No longitudinal evidence for shape sound symbolism in the first year.

The maluma/takete effect refers to an association between certain language sounds (e.g., /m/ and /o/) and round shapes, and other language sounds (e.g., /t/ and /i/) and spiky shapes. This is an example of sound symbolism and stands in opposition to arbitrariness of language. It is still unknown when sensitivity to sound symbolism emerges. In the present series of studies, we first confirmed that the classic maluma/takete effect would be observed in adults using our novel 3-D object stimuli (Experiments 1a and 1b). We then conducted the first longitudinal test of the maluma/takete effect, testing infants at 4-, 8- and 12-months of age (Experiment 2). Sensitivity to sound symbolism was measured with a looking time preference task, in which infants were shown images of a round and a spiky 3-D object while hearing either a round- or spiky-sounding nonword. We did not detect a significant difference in looking time based on nonword type. We also collected a series of individual difference measures including measures of vocabulary, movement ability and babbling. Analyses of these measures revealed that 12-month olds who babbled more showed a greater sensitivity to sound symbolism. Finally, in Experiment 3, we had parents take home round or spiky 3-D printed objects, to present to 7- to 8-month-old infants paired with either congruent or incongruent nonwords. This language experience had no effect on subsequent measures of sound symbolism sensitivity. Taken together these studies demonstrate that sound symbolism is elusive in the first year, and shed light on the mechanisms that may contribute to its eventual emergence.

I don't see what you're saying: The maluma/takete effect does not depend on the visual appearance of phonemes as they are articulated.

In contrast to the principle of arbitrariness, recent work has shown that language can iconically depict referents being talked about. One such example is the maluma/takete effect: an association between certain phonemes (e.g., those in maluma) and round shapes, and other phonemes (e.g., those in takete and spiky shapes). An open question has been whether this association is crossmodal (arising from phonemes' sound or kinesthetics) or unimodal (arising from phonemes' visual appearance). In the latter case, individuals may associate a person's rounded lips as they pronounce the /u/ in maluma with round shapes. We examined this hypothesis by having participants pair nonwords with shapes in either an audio-only condition (they only heard nonwords) or an audiovisual condition (they both heard nonwords and saw them articulated). We found no evidence that seeing nonwords articulated enhanced the maluma/takete effect. In fact, there was evidence that it decreased it in some cases. This was confirmed with a Bayesian analysis. These results eliminate a plausible explanation for the maluma/takete effect, as an instance of visual matching. We discuss the alternate possibility that it involves crossmodal associations.

Is a boat bigger than a ship? Null results in the investigation of vowel sound symbolism on size judgements in real language.

Sound symbolism is the phenomenon by which certain kinds of phonemes are associated with perceptual and/or semantic properties. In this article, we explored size sound symbolism (i.e., the mil/mal effect) in which high-front vowels (e.g., /i/) show an association with smallness, while low-back vowels (e.g., /ɑ/) show an association with largeness. This has previously been demonstrated with nonwords, but its impact on the processing of real language is unknown. We investigated this using a size judgement task, in which participants classified words for small or large objects, containing a small- or large-associated vowel, based on their size. Words were presented auditorily in Experiment 1 and visually in Experiment 2. We did not observe an effect of vowel congruence (i.e., between object size and the size association of its vowel) in either of the experiments. This suggests that there are limits to the impact of sound symbolism on the processing of real language.

Heterogenous abstract concepts: is "ponder" different from "dissolve"?

words have usually been treated as a homogenous group, with limited investigation of the influence of different underlying representational systems for these words. In the present study we examined lexical-semantic processing of abstract verbs, separating them into mental state, emotional state and nonembodied state types. We used a syntactic classification task and a memory task to investigate behavioural differences amongst the abstract verb types. Semantic richness effects of each of the verbs' associates were then investigated to determine the relationship of linguistic associations to semantic processing response times for abstract verbs. We found a modest effect of abstract verb type, with mental state abstract verbs processed more quickly than nonembodied abstract verbs in the syntactic classification task; however, this effect was task dependent. We also found that memory was less accurate for the mental state abstract verbs. The semantic richness analysis of abstract verb associates revealed (1) that the concreteness of an abstract verb's associates has a positive relationship to the verb's response time and (2) a negative relationship between response time and age of acquisition for associates of nonembodied verbs. The results provide support for the proposal that abstract concepts engage complex representations in modal and linguistic systems.

An investigation of iconic language development in four datasets.

Iconic words imitate their meanings. Previous work has demonstrated that iconic words are more common in infants' early speech, and in adults' child-directed speech (e.g., Perry et al., 2015; 2018). This is consistent with the proposal that iconicity provides a benefit to word learning. Here we explored iconicity in four diverse language development datasets: a production corpus for infants and preschoolers (MacWhinney, 2000), comprehension data for school-aged children to young adults (Dale & O'Rourke, 1981), word frequency norms from educational texts for school aged children to young adults (Zeno et al., 1995), and a database of parent-reported infant word production (Frank et al., 2017). In all four analyses, we found that iconic words were more common at younger ages. We also explored how this relationship differed by syntactic class, finding only modest evidence for differences. Overall, the results suggest that, beyond infancy, iconicity is an important factor in language acquisition.

Impact of perceived interpersonal similarity on attention to the eyes of same-race and other-race faces.

One reason for the persistence of racial discrimination may be anticipated dissimilarity with racial outgroup members that prevent meaningful interactions. In the present research, we investigated whether perceived similarity would impact the processing of same-race and other-race faces. Specifically, in two experiments, we varied the extent to which White participants were ostensibly similar to targets via bogus feedback on a personality test. With an eye tracker, we measured the effect of this manipulation on attention to the eyes, a critical region for person perception and face memory. In Experiment 1, we monitored the impact of perceived interpersonal similarity on White participants' attention to the eyes of same-race White targets. In Experiment 2, we replicated this procedure, but White participants were presented with either same-race White targets or other-race Black targets in a between-subjects design. The pattern of results in both experiments indicated a positive linear effect of similarity-greater perceived similarity between participants and targets predicted more attention to the eyes of White and Black faces. The implications of these findings related to top-down effects of perceived similarity for our understanding of basic processes in face perception, as well as intergroup relations, are discussed.

Implications of the "Language as Situated" View for Written Iconicity.

In their review, Murgiano, Motamedi, and Vigliocco (2020) lay out a new perspective in which they argue that language should be understood as a situated phenomenon. This perspective has implications for the study of written language, which is fundamentally an un-situated phenomenon. We consider the implications of this perspective for iconicity as it appears in written language. We argue that typical methods for studying word processing (e.g., the lexical decision task) may be bound to underestimate the relevance of iconicity for language. In addition, the typical approach of collecting ratings of individual words on a lexical-semantic dimension may not be well suited to quantifying iconicity. Nevertheless, we believe the field should continue to explore effects of iconicity in language processing, and we discuss some potential ways to adjust traditional word processing tasks.

Sound symbolism shapes the English language: The maluma/takete effect in English nouns.

Sound symbolism refers to associations between language sounds (i.e., phonemes) and perceptual and/or semantic features. One example is the maluma/takete effect: an association between certain phonemes (e.g., /m/, /u/) and roundness, and others (e.g., /k/, /ɪ/) and spikiness. While this association has been demonstrated in laboratory tasks with nonword stimuli, its presence in existing spoken language is unknown. Here we examined whether the maluma/takete effect is attested in English, across a broad sample of words. Best-worst judgments from 171 university students were used to quantify the shape of 1,757 objects, from spiky to round. We then examined whether the presence of certain phonemes in words predicted the shape of the objects to which they refer. We found evidence that phonemes associated with roundness are more common in words referring to round objects, and phonemes associated with spikiness are more common in words referring to spiky objects. This represents an instance of iconicity, and thus nonarbitrariness, in human language.

Iconicity emerges and is maintained in spoken language.

Iconicity is the property whereby signs (vocal or manual) resemble their referents. Iconic signs are easy to relate to the world, facilitating learning and processing. In this study, we examined whether the benefits of iconicity would lead to its emergence and to maintenance in language. We focused on shape iconicity (the association between rounded objects and round-sounding words like "bouba" and between spiky objects and spiky-sounding words like "kiki") and motion iconicity (the association between longer words and longer events). In Experiment 1, participants generated novel labels for round versus spiky shapes and long versus short movements (Experiment 1a: text, Experiment 1b: speech). Labels for each kind of stimulus differed in a way that was consistent with previous studies of iconicity. This suggests that iconicity emerges even on a completely unconstrainted task. In Experiment 2 (Experiment 2a: text, Experiment 2b: speech), we simulated language change in the laboratory (as iterated learning) and found that both forms of iconicity were introduced and maintained through generations of language users. Thus, we demonstrate the emergence of iconicity in spoken languages, and we argue that these results reflect a pressure for language systems to be referential, which favors iconic forms in the cultural evolution of language (at least up to a point where it is balanced by other pressures, e.g., discriminability). This can explain why we have iconicity across natural languages and may have implications for debates on language origins. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Teaching sarcasm: Evaluating metapragmatic training for typically developing children.

Sarcasm is a common form of social language but one that can be challenging for children to understand. We investigated whether training can enhance children's ability to understand sarcasm. Participants were 111 five- to six- year-olds, assigned to either the training or control condition. In both conditions, children were first shown a series of puppet shows. Each puppet show ended with a sarcastic or literal remark. After each show children were asked about speaker belief, intent, and humour. Children's responses were used to estimate their pretraining sarcasm understanding. In the training condition, children were taught what sarcasm was and what cues to look for as they interacted with the researcher over a set of stories where characters made either sarcastic or literal remarks. In the control condition children read a nonsarcastic storybook with the researcher. Children's understanding of sarcasm was then reassessed using another series of puppet shows. For children who were not already proficient in sarcasm understanding, training was associated with more accurate speaker belief and intent responses and more accurate sarcasm detection. Training was not related to children's speaker humour responses. Thus, the findings of the present study provide evidence that aspects of children's sarcasm understanding can be enhanced through training. The training paradigm could be developed further to test its effectiveness in other populations who struggle with sarcasm understanding, and to help refine theories of irony development. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Effects of Emotional Valence and Concreteness on Children's Recognition Memory.

There are considerable gaps in our knowledge of how children develop abstract language. In this paper, we tested the Affective Embodiment Account, which proposes that emotional information is more essential for abstract than concrete conceptual development. We tested the recognition memory of 7- and 8-year-old children, as well as a group of adults, for abstract and concrete words which differed categorically in valence (negative, neutral, and positive). Word valence significantly interacted with concreteness in hit rates of both children and adults, such that effects of valence were only found in memory for abstract words. The pattern of valence effects differed for children and adults: children remembered negative words more accurately than neutral and positive words (a negativity effect), whereas adults remembered negative and positive words more accurately than neutral words (a negativity effect and a positivity effect). In addition, signal detection analysis revealed that children were better able to discriminate negative than positive words, regardless of concreteness. The findings suggest that the memory accuracy of 7- and 8-year-old children is influenced by emotional information, particularly for abstract words. The results are in agreement with the Affective Embodiment Account and with multimodal accounts of children's lexical development.

Mapping semantic space: property norms and semantic richness.

In semantic property listing tasks, participants list many features for some concepts and fewer for others. This variability in number of features (NoF) has been used in previous research as a measure of a concept's semantic richness, and such studies have shown that in lexical-semantic tasks responses tend to be facilitated for words with high NoF compared to those for words with low NoF, even when many other relevant factors are controlled (Pexman et al. in Psychon Bull Rev 9:542-549, 2002; Mem Cogn 31:842-855, 2003; Psychon Bull Rev 15:161-167, 2008; Goh et al. in Front Psychol, 2016. https://doi.org/10.3389/fpsyg.2016.00976 ). Furthermore, shared features (i.e., features that are shared by multiple words) appear to facilitate responses in lexical-semantic tasks to a greater degree than distinctive features (Devereux et al. in Cogn Sci 40:325-350, 2016; Grondin et al. in J Mem Lang 60:1-19, 2009). This previous work was limited, however, to relatively small sets of words, typically those extracted from the McRae norms (McRae et al. in Behav Res Methods 37(4):547-559, 2005). New property listing norms provide the opportunity to extract NoF values for many more items (Buchanan et al. in Behav Res Methods 51:1849-1863, 2019). The purpose of the present study was to test whether NoF effects generalize to this larger item set, and to explore how NoF is related to other measures of semantic richness, including subjective ratings of concreteness, imageability, body-object interaction, sensory experience, valence, arousal, and age of acquisition, as well as more objective measures like semantic diversity, number of associates, and lexical centrality. Using the new Buchanan norms, we found significant NoF effects in lexical decision (is it a word or a nonword?) and semantic decision (is it concrete or abstract?) tasks. We also found significant effects of words' number of shared (less distinctive) features in each task. Further, factor analyses of all semantic richness measures showed a distinct factor structure, suggesting that there are clusters of semantic richness dimensions that seem to correspond to more embodied semantic dimensions and more distributional semantic dimensions. Results are interpreted as evidence that semantic representation is multimodal and multidimensional, and provide new insights about the structure of semantic space.

Is un stylo sharper than une épée? Investigating the interaction of sound symbolism and grammatical gender in English and French speakers.

While the arbitrariness of language has long been considered one of its defining features, there is growing evidence that non-arbitrariness also plays an important role. Here we investigated two sources of non-arbitrariness: systematicity (via grammatical gender) and iconicity (via shape sound symbolism). We manipulated these two elements orthogonally, allowing us to examine the effect of each. In Experiment 1, we found that French speakers associated nonwords containing feminine (masculine) endings with round (sharp) shapes. French speakers also associated nonwords containing round-sounding (sharp-sounding) phonemes with round (sharp) shapes. This was repeated using auditory presentation with both an English-speaking (Experiment 2a) and French-speaking (Experiment 2b) sample. As predicted, the English speakers showed no effects of grammatical gender, while the French speakers did. These results demonstrate that speakers of a language with grammatical gender associate different properties to words belonging to different genders. The results also show that sound symbolism can emerge in stimuli with existing associated information (i.e., endings indicative of grammatical gender, and the association that they evoke). Finally, while previous studies have looked at effects of arbitrary and non-arbitrary mappings contained in a single stimulus, this is the first study to demonstrate that different kinds of non-arbitrary mappings can have an effect when appearing in the same stimulus. Together these results add to our understanding of the importance of non-arbitrariness in language.

Does the name say it all? Investigating phoneme-personality sound symbolism in first names.

Sound symbolism has typically been demonstrated as an association between certain phonemes and perceptual dimensions (e.g., size or shape). For instance, the maluma-takete effect is the sound symbolic association between sonorant and voiceless stop phonemes and round and sharp visual shapes, respectively. Here we explored a novel association between phonemes and a more abstract dimension: personality. Further, although sound symbolism has often been examined using nonwords, here we studied it in the context of existing first names. In Experiments 1 and 2, we presented first names containing sonorant versus voiceless stop consonants and found that participants associated these with different personality factors from the HEXACO model of personality. In general, names with sonorant phonemes (e.g., Mona, Owen) were associated with high Emotionality, Agreeableness, and Conscientiousness, whereas names with voiceless stop phonemes (e.g., Katie, Curtis) were associated with high Extraversion. In Experiment 3, we examined whether the associations of a person's name predict their personality. A sample of 1,071 individuals provided their names and completed a HEXACO personality inventory. We found no real-world evidence of the associations we observed in the lab. In Experiment 4, we used invented names and tested participants in the lab once again, finding evidence of the same associations as in Experiment 1 and 2. This suggests that phonemes, and not just existing knowledge of individuals with particular names, are key to the associations observed. Finally, in Experiment 5, we found that these effects are not mediated by likability. We discuss potential mechanisms for the observed associations. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Sensitivity to emotion information in children's lexical processing.

We tested predictions of multiple representation accounts of conceptual processing, including the proposal that emotion information may provide a bootstrapping mechanism for vocabulary acquisition. We investigated the influence of word valence on children's lexical processing, presenting 40 positive words, 40 neutral words, and 40 negative words in an auditory lexical decision task (ALDT), along with 120 nonwords. We tested 99 children across three age groups: 5, 6, or 7 years. There were no significant effects of valence on the ALDT responses of 5-year-old children. The 6-year-old children, however, were faster to respond to negative words than to neutral words and, for more abstract words, faster to respond to positive words than to neutral words. The 7-year-old children were faster for positive words than for neutral words, regardless of concreteness. As such, children showed sensitivity to word valence in lexical processing, at a younger age than had been established in previous research. In addition, children's language skills were related to their improved processing of more abstract neutral words between 6 and 7 years of age. These results are consistent with multimodal accounts of word meaning and lexical development.

Perceiving happiness in an intergroup context: The role of race and attention to the eyes in differentiating between true and false smiles.

The present research comprises six experiments that investigated racial biases in the perception of positive emotional expressions. In an initial study, we demonstrated that White participants distinguished more in their happiness ratings of Duchenne ("true") and non-Duchenne ("false") smiles on White compared with Black faces (Experiment 1). In a subsequent study we replicated this effect using a different set of stimuli and non-Black participants (Experiment 2). As predicted, this bias was not demonstrated by Black participants, who did not significantly differ in happiness ratings between smile types on White and Black faces (Experiment 3). Furthermore, in addition to happiness ratings, we demonstrated that non-Black participants were also more accurate when categorizing true versus false expressions on White compared with Black faces (Experiment 4). The final two studies provided evidence for the mediating role of attention to the eyes in intergroup emotion identification. In particular, eye tracking data indicated that White participants spent more time attending to the eyes of White than Black faces and that attention to the eyes predicted biases in happiness ratings between true and false smiles on White and Black faces (Experiment 5). Furthermore, an experimental manipulation focusing participants on the eyes of targets eliminated the effects of target race or perceptions of happiness (Experiment 6). Together, the findings provide novel evidence for racial biases in the identification of positive emotions and highlight the critical role of visual attention in this process. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Quantifying sensorimotor experience: Body-object interaction ratings for more than 9,000 English words.

Ratings of body-object interaction (BOI) measure the ease with which the human body can interact with a word's referent. Researchers have studied the effects of BOI in order to investigate the relationships between sensorimotor and cognitive processes. Such efforts could be improved, however, by the availability of more extensive BOI norms. In the present work, we collected BOI ratings for over 9,000 words. These new norms show good reliability and validity and have extensive overlap with the words used both in other lexical and semantic norms and in the available behavioral megastudies (e.g., the English Lexicon Project, Balota, Yap, Cortese, Hutchison, Kessler, & Loftis in Behavior Research Methods, 39, 445-459, 2007; and the Calgary Semantic Decision Project, Pexman, Heard, Lloyd, & Yap in Behavior Research Methods, 49, 407-417, 2017). In analyses using the new BOI norms, we found that high-BOI words tended to be more concrete, more graspable, and more strongly associated with sensory, haptic, and visual experience than are low-BOI words. When we used the new norms to predict response latencies and accuracy data from the behavioral megastudies, we found that BOI was a stronger predictor of responses in the semantic decision task than in the lexical decision task. These findings are consistent with a dynamic, multidimensional account of lexical semantics. The norms described here should be useful for future research examining the effects of sensorimotor experience on performance in tasks involving word stimuli.

Prediction of beauty and liking ratings for abstract and representational paintings using subjective and objective measures.

Recent research on aesthetics has challenged the adage that "beauty is in the eye of the beholder" by identifying several factors that predict ratings of beauty. However, this research has emerged in a piecemeal fashion. Most studies have examined only a few predictors of beauty, and measured either subjective or objective predictors, but not both. Whether the predictors of ratings of beauty versus liking differ has not been tested, nor has whether predictors differ for major distinctions in art, such as abstract vs. representational paintings. Finally, past studies have either relied on experimenter-generated stimuli-which likely yield pallid aesthetic experiences-or on a curation of high-quality art-thereby restricting the range of predictor scores. We report a study (N = 598) that measured 4 subjective and 11 objective predictors of both beauty ratings and liking ratings, for 240 abstract and 240 representational paintings that varied widely in beauty. A crossover pattern occurred in the ratings, such that for abstract paintings liking ratings were higher than beauty ratings, whereas for representational paintings beauty ratings were higher than liking ratings. Prediction was much better for our subjective than objective predictors, and much better for our representational than abstract paintings. For abstract paintings, liking ratings were much more predictable than beauty ratings. Implications and directions for future research are discussed.

Communicating abstract meaning: concepts revealed in words and gestures.

words refer to concepts that cannot be directly experienced through our senses (e.g. truth, morality). How we ground the meanings of abstract words is one of the deepest problems in cognitive science today. We investigated this question in an experiment in which 62 participants were asked to communicate the meanings of words (20 abstract nouns, e.g. impulse; 10 concrete nouns, e.g. insect) to a partner without using the words themselves (the taboo task). We analysed the speech and associated gestures that participants used to communicate the meaning of each word in the taboo task. Analysis of verbal and gestural data yielded a number of insights. When communicating about the meanings of abstract words, participants' speech referenced more people and introspections. In contrast, the meanings of concrete words were communicated by referencing more objects and entities. Gesture results showed that when participants spoke about abstract word meanings their speech was accompanied by more metaphorical and beat gestures, and speech about concrete word meanings was accompanied by more iconic gestures. Taken together, the results suggest that abstract meanings are best captured by a model that allows dynamic access to multiple representation systems.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.