Iconicity ratings for 14,000+ English words.

Iconic words and signs are characterized by a perceived resemblance between aspects of their form and aspects of their meaning. For example, in English, iconic words include peep and crash, which mimic the sounds they denote, and wiggle and zigzag, which mimic motion. As a semiotic property of words and signs, iconicity has been demonstrated to play a role in word learning, language processing, and language evolution. This paper presents the results of a large-scale norming study for more than 14,000 English words conducted with over 1400 American English speakers. We demonstrate the utility of these ratings by replicating a number of existing findings showing that iconicity ratings are related to age of acquisition, sensory modality, semantic neighborhood density, structural markedness, and playfulness. We discuss possible use cases and limitations of the rating dataset, which is made publicly available.

Linking language to sensory experience: Onomatopoeia in early language development.

A key question in developmental research concerns how children learn associations between words and meanings in their early language development. Given a vast array of possible referents, how does the child know what a word refers to? We contend that onomatopoeia (e.g. knock, meow), where a word's sound evokes the sound properties associated with its meaning, are particularly useful in children's early vocabulary development, offering a link between word and sensory experience not present in arbitrary forms. We suggest that, because onomatopoeia evoke imagery of the referent, children can draw from sensory experience to easily link onomatopoeic words to meaning, both when the referent is present as well as when it is absent. We use two sources of data: naturalistic observations of English-speaking caregiver-child interactions from 14 up to 54 months, to establish whether these words are present early in caregivers' speech to children, and experimental data to test whether English-speaking children can learn from onomatopoeia when it is present. Our results demonstrate that onomatopoeia: (a) are most prevalent in early child-directed language and in children's early productions, (b) are learnt more easily by children compared with non-iconic forms and (c) are used by caregivers in contexts where they can support communication and facilitate word learning.

Natural reference: A phylo- and ontogenetic perspective on the comprehension of iconic gestures and vocalizations.

The recognition of iconic correspondence between signal and referent has been argued to bootstrap the acquisition and emergence of language. Here, we study the ontogeny, and to some extent the phylogeny, of the ability to spontaneously relate iconic signals, gestures, and/or vocalizations, to previous experience. Children at 18, 24, and 36 months of age (N = 216) and great apes (N = 13) interacted with two apparatuses, each comprising a distinct action and sound. Subsequently, an experimenter mimicked either the action, the sound, or both in combination to refer to one of the apparatuses. Experiments 1 and 2 found no spontaneous comprehension in great apes and in 18-month-old children. At 24 months of age, children were successful with a composite vocalization-gesture signal but not with either vocalization or gesture alone. At 36 months, children succeeded both with a composite vocalization-gesture signal and with gesture alone, but not with vocalization alone. In general, gestures were understood better compared to vocalizations. Experiment 4 showed that gestures were understood irrespective of how children learned about the corresponding action (through observation or self-experience). This pattern of results demonstrates that iconic signals can be a powerful way to establish reference in the absence of language, but they are not trivial for children to comprehend and not all iconic signals are created equal.

A perceptual advantage for onomatopoeia in early word learning: Evidence from eye-tracking.

A perceptual advantage for iconic forms in infant language learning has been widely reported in the literature, termed the "sound symbolism bootstrapping hypothesis" by Imai and Kita (2014). However, empirical research in this area is limited mainly to sound symbolic forms, which are very common in languages such as Japanese but less so in Indo-European languages such as English. In this study, we extended this body of research to onomatopoeia-words that are thought to be present across most of the world's languages and that are known to be dominant in infants' early lexicons. In a picture-mapping task, 10- and 11-month-old infants showed a processing advantage for onomatopoeia (e.g., woof woof) over their conventional counterparts (e.g., doggie). However, further analysis suggests that the input may play a key role in infants' experience and processing of these forms.

Using Japanese Onomatopoeias to Explore Perceptual Dimensions in Visual Material Perception.

This study examined the perceptual dimensions of visual material properties. Photographs of 50 objects were presented to the participants, and they reported a suitable onomatopoeia (mimetic word) for describing the material of the object in each photograph, based on visual appearance. The participants' responses were collated into a contingency table of photographs × onomatopoeias. After removing some items from the table, correspondence analysis was applied to the contingency table, and a six-dimensional biplot was obtained. By rotating the axes to maximize sparseness of the coordinates for the items in the biplot, three meaningful perceptual dimensions were derived: wetness/stickiness, fluffiness/softness, and smoothness-roughness/gloss-dullness. Two additional possible dimensions were obtained: crumbliness and coldness. These dimensions, except gloss-dullness, were paid little attention to in vision science, though they were suggested as perceptual dimensions of tactile texture. This suggests that the perceptual dimensions that are considered to be primarily related to haptics are also important in visual material perception.

Choreographing Compassion: A Clinical Adventure of Rhythms.

Compassion is a primary catalyst motivating positive human relationships, especially of those less fortunate. Our rhythms Expand-Contract of our own non-verbal body joints movements and of the law of counter-balance, enable us to identify which of nine innate affects-emotions is directing the body's movements. With this reading, a trained person can synchronize choreography of these into fully authentic compassion between two or more persons. Primary references for this are the late Silvan S. Tomkins's four volumes "Affect Imagery Consciousness," and choreographers the late Rudolf Laban, Warren Lamb, Irmgard Bartenieff, and Marian Chace. Professionals, clinicians, and laity counselors can all use these.

Selectively manipulating softness perception of materials through sound symbolism.

Cross-modal interactions between auditory and haptic perception manifest themselves in language, such as sound symbolic words: crunch, splash, and creak. Several studies have shown strong associations between sound symbolic words, shapes (e.g., Bouba/Kiki effect), and materials. Here, we identified these material associations in Turkish sound symbolic words and then tested for their effect on softness perception. First, we used a rating task in a semantic differentiation method to extract the perceived softness dimensions from words and materials. We then tested whether Turkish onomatopoeic words can be used to manipulate the perceived softness of everyday materials such as honey, silk, or sand across different dimensions of softness. In the first preliminary study, we used 40 material videos and 29 adjectives in a rating task with a semantic differentiation method to extract the main softness dimensions. A principal component analysis revealed seven softness components, including Deformability, Viscosity, Surface Softness, and Granularity, in line with the literature. The second preliminary study used 27 onomatopoeic words and 21 adjectives in the same rating task. Again, the findings aligned with the literature, revealing dimensions such as Viscosity, Granularity, and Surface Softness. However, no factors related to Deformability were found due to the absence of sound symbolic words in this category. Next, we paired the onomatopoeic words and material videos based on their associations with each softness dimension. We conducted a new rating task, synchronously presenting material videos and spoken onomatopoeic words. We hypothesized that congruent word-video pairs would produce significantly higher ratings for dimension-related adjectives, while incongruent word-video pairs would decrease these ratings, and the ratings of unrelated adjectives would remain the same. Our results revealed that onomatopoeic words selectively alter the perceived material qualities, providing evidence and insight into the cross-modality of perceived softness.

Cognitive neural responses in the semantic comprehension of sound symbolic words and pseudowords.

Introduction: Sound symbolism is the phenomenon of sounds having non-arbitrary meaning, and it has been demonstrated that pseudowords with sound symbolic elements have similar meaning to lexical words. It is unclear how the impression given by the sound symbolic elements is semantically processed, in contrast to lexical words with definite meanings. In event-related potential (ERP) studies, phonological mapping negativity (PMN) and N400 are often used as measures of phonological and semantic processing, respectively. Therefore, in this study, we analyze PMN and N400 to clarify the differences between existing sound symbolic words (onomatopoeia or ideophones) and pseudowords in terms of semantic and phonological processing. Methods: An existing sound symbolic word and pseudowords were presented as an auditory stimulus in combination with a picture of an event, and PMN and N400 were measured while the subjects determined whether the sound stimuli and pictures match or mismatch. Results: In both the existing word and pseudoword tasks, the amplitude of PMN and N400 increased when the picture of an event and the speech sound did not match. Additionally, compared to the existing words, the pseudowords elicited a greater amplitude for PMN and N400. In addition, PMN latency was delayed in the mismatch condition relative to the match condition for both existing sound symbolic words and pseudowords. Discussion: We concluded that established sound symbolic words and sound symbolic pseudowords undergo similar semantic processing. This finding suggests that sound symbolism pseudowords are not judged on a simple impression level (e.g., spiky/round) or activated by other words with similar spellings (phonological structures) in the lexicon, but are judged on a similar contextual basis as actual words.

Induced and Evoked Brain Activation Related to the Processing of Onomatopoetic Verbs.

Grounded cognition theory postulates that cognitive processes related to motor or sensory content are processed by brain networks involved in motor execution and perception, respectively. Processing words with auditory features was shown to activate the auditory cortex. Our study aimed at determining whether onomatopoetic verbs (e.g., "tröpfeln"-to dripple), whose articulation reproduces the sound of respective actions, engage the auditory cortex more than non-onomatopoetic verbs. Alpha and beta brain frequencies as well as evoked-related fields (ERFs) were targeted as potential neurophysiological correlates of this linguistic auditory quality. Twenty participants were measured with magnetoencephalography (MEG) while semantically processing visually presented onomatopoetic and non-onomatopoetic German verbs. While a descriptively stronger left temporal alpha desynchronization for onomatopoetic verbs did not reach statistical significance, a larger ERF for onomatopoetic verbs emerged at about 240 ms in the centro-parietal area. Findings suggest increased cortical activation related to onomatopoeias in linguistically relevant areas.

What do we mean with sound semantics, exactly? A survey of taxonomies and ontologies of everyday sounds.

Taxonomies and ontologies for the characterization of everyday sounds have been developed in several research fields, including auditory cognition, soundscape research, artificial hearing, sound design, and medicine. Here, we surveyed 36 of such knowledge organization systems, which we identified through a systematic literature search. To evaluate the semantic domains covered by these systems within a homogeneous framework, we introduced a comprehensive set of verbal sound descriptors (sound source properties; attributes of sensation; sound signal descriptors; onomatopoeias; music genres), which we used to manually label the surveyed descriptor classes. We reveal that most taxonomies and ontologies were developed to characterize higher-level semantic relations between sound sources in terms of the sound-generating objects and actions involved (what/how), or in terms of the environmental context (where). This indicates the current lack of a comprehensive ontology of everyday sounds that covers simultaneously all semantic aspects of the relation between sounds. Such an ontology may have a wide range of applications and purposes, ranging from extending our scientific knowledge of auditory processes in the real world, to developing artificial hearing systems.

Examining the Effect of Adverbs and Onomatopoeia on Physical Movement.

Introduction: The effect of promoting a physical reaction by the described action is called the action-sentence compatibility effect (ACE). It has been verified that physical motion changes depending on the time phase and grammatical expression. However, it is unclear how adverbs and onomatopoeia change motion simulations and subsequent movements. Methods: The subjects were 35 healthy adults (11 females; mean age 21.3). We prepared 20 sentences each, expressing actions related to hands and feet. These were converted into 80 sentences (stimulus set A), with the words "Slow" or "Quick" added to the words related to the speed of movement, and 80 sentences (stimulus set B) with the words "Fast" and onomatopoeia "Satto" added. Additionally, 20 unnatural sentences were prepared for each stimulus set as pseudo sentences. Choice reaction time was adopted; subjects pressed the button with their right hand only when the presented text was correctly understood (Go no-go task). The reaction time (RTs) and the number of errors (NoE) were recorded and compared. Results: As a result of a two-way repeated ANOVA, an interaction effect (body parts × words) was observed in RTs and NoE in set A. "Hand and Fast" had significantly faster RTs than "Hand and Slow" and "Foot and Fast." Furthermore, "Hand and Fast" had a significantly higher NoE than others. In set B, the main effects were observed in both RTs and NoE. "Hand" and "Satto" had significantly faster RTs than "Foot" and "Quick," respectively. Additionally, an interaction effect was observed in NoE, wherein "Foot and Satto" was significantly higher than "Hand and Satto" and "Foot and Quick." Conclusion: In this study, the word "Fast" promoted hand response, reaffirming ACE. The onomatopoeia "Satto" was a word that conveys the speed of movement, but it was suggested that the degree of understanding may be influenced by the body part and the attributes of the subject.

Computer Vision System for Expressing Texture Using Sound-Symbolic Words.

The major goals of texture research in computer vision are to understand, model, and process texture and ultimately simulate human visual information processing using computer technologies. The field of computer vision has witnessed remarkable advancements in material recognition using deep convolutional neural networks (DCNNs), which have enabled various computer vision applications, such as self-driving cars, facial and gesture recognition, and automatic number plate recognition. However, for computer vision to "express" texture like human beings is still difficult because texture description has no correct or incorrect answer and is ambiguous. In this paper, we develop a computer vision method using DCNN that expresses texture of materials. To achieve this goal, we focus on Japanese "sound-symbolic" words, which can describe differences in texture sensation at a fine resolution and are known to have strong and systematic sensory-sound associations. Because the phonemes of Japanese sound-symbolic words characterize categories of texture sensations, we develop a computer vision method to generate the phonemes and structure comprising sound-symbolic words that probabilistically correspond to the input images. It was confirmed that the sound-symbolic words output by our system had about 80% accuracy rate in our evaluation.

Automatic Estimation of Multidimensional Personality From a Single Sound-Symbolic Word.

Researchers typically use the "big five" traits (Extroversion, Agreeableness, Conscientiousness, Neuroticism, and Openness) as a standard way to describe personality. Evaluation of personality is generally conducted using self-report questionnaires that require participants to respond to a large number of test items. To minimize the burden on participants, this paper proposes an alternative method of estimating multidimensional personality traits from only a single word. We constructed a system that can convert a sound-symbolic word (SSW) that intuitively expresses personality traits into information expressed by 50 personality-related adjective pairs. This system can obtain information equivalent to the adjective scales using only a single word instead of asking many direct questions. To achieve this, we focused on SSWs in Japanese that have the association between linguistic sounds and meanings and express diverse and complex aspects of personality traits. We evaluated the prediction accuracy of the system and found that the multiple correlation coefficients for 48 personality-related adjective pairs exceeded 0.75, indicating that the model could explain more than half of the variations in the data. In addition, we conducted an evaluation experiment in which participants rated the appropriateness of the system output using a seven-point scale (with -3 as absolutely inappropriate and +3 as completely appropriate). The average score for 50 personality-related adjective pairs was 1.25. Thus, we believe that this system can contribute to the field of personality computing, particularly in terms of personality evaluation and communication.

Food-texture dimensions expressed by Japanese onomatopoeic words.

This study examined perceptual dimensions of food texture using Japanese onomatopoeic words. Photographs of 56 foods were presented to the participants, and they reported onomatopoeic (mimetic) words suitable for the texture of the foods. The participants' responses were collated into a contingency table of photographs by onomatopoeic words. Correspondence analysis was applied to the table, and 15 dimensions were extracted. The biplot of the configurations was rotated by the technique of sparse coding. The obtained dimensions were smoothness/sounds in slurping noodles; adhesiveness; crumbliness/dryness/fluffiness of breads; popping/juiciness of spherical-shaped foods; soft elasticity/smoothness of gel, wateriness/creaminess; bendability of sticky foods; crispness/crunchiness of snacks; crispness of fruits; elasticity; crunchiness of vegetables; breakability of rod-like foods; sizzle (high temperature and oiliness); and two dimensions specifically expressing textures of lemon and pickled plum. These are considered to be basic food-texture dimensions expressed by Japanese onomatopoeic words.

From imitation to meaning: circuit plasticity and the acquisition of a conventionalized semantics.

The capacity for language is arguably the most remarkable innovation of the human brain. A relatively recent interpretation prescribes that part of the language-related circuits were co-opted from circuitry involved in hand control-the mirror neuron system (MNS), involved both in the perception and in the execution of voluntary grasping actions. A less radical view is that in early humans, communication was opportunistic and multimodal, using signs, vocalizations or whatever means available to transmit social information. However, one point that is not yet clear under either perspective is how learned communication acquired a semantic property thereby allowing us to name objects and eventually describe our surrounding environment. Here we suggest a scenario involving both manual gestures and learned vocalizations that led to the development of a primitive form of conventionalized reference. This proposal is based on comparative evidence gathered from other species and on neurolinguistic evidence in humans, which points to a crucial role for vocal learning in the early development of language. Firstly, the capacity to direct the attention of others to a common object may have been crucial for developing a consensual referential system. Pointing, which is a ritualized grasping gesture, may have been crucial to this end. Vocalizations also served to generate joint attention among conversants, especially when combined with gaze direction. Another contributing element was the development of pantomimic actions resembling events or animals. In conjunction with this mimicry, the development of plastic neural circuits that support complex, learned vocalizations was probably a significant factor in the evolution of conventionalized semantics in our species. Thus, vocal imitations of sounds, as in onomatopoeias (words whose sound resembles their meaning), are possibly supported by mirror system circuits, and may have been relevant in the acquisition of early meanings.