The role of visual imagery in story reading: Evidence from aphantasia.

Aphantasia is a condition in which people are unable to experience visual imagery. Since visual imagery is thought to be key to language processing, we hypothesized the experience of a story would differ between individuals with aphantasia and controls. Forty-seven individuals with aphantasia were compared to fifty-one matched controls on their experience of reading a short story and their general reading habits. Aphantasics were less likely to be engaged with, interested in, and absorbed in the story, and experienced reduced emotional engagement with and sympathy for the story characters, compared to controls. Yet, aphantasics and controls did not differ in how much they liked or appreciated the story, and in general, the reading habits of the two groups also did not differ. Results have implications for embodied theories of language, suggesting visual imagery may influence how a story is experienced, but it is not the only route to story enjoyment.

Ratings of valence, arousal, happiness, anger, fear, sadness, disgust, and surprise for 24,000 Dutch words.

Emotion is a fundamental aspect of human life and therefore is critically encoded in language. To facilitate research into the encoding of emotion in language and how emotion associations affect language processing, we present a new set of emotion norms for over 24,000 Dutch words. The emotion norms include ratings of two key dimensions of emotion: valence and arousal, as well as ratings on discrete emotion categories: happiness, anger, fear, sadness, disgust, and surprise. We show that emotional information can predict word processing, such that responses to positive words are facilitated in contrast to neutral and negative words. We also demonstrate how the ratings of emotion are related to personality characteristics. The data are available via the Open Science Framework ( https://osf.io/9htuv/ ) and serve as a valuable resource for research into emotion as well as in applied settings such as healthcare and digital communication.

Dutch sensory modality norms.

Many words are strongly connected to the senses, such as vision, taste, and touch. In order to facilitate research on language and the senses, large sets of linguistic stimuli and their corresponding measures of sensory associations should be available. To aid in such investigations, we present a new set of sensory modality norms for over 24,000 Dutch words. The sensory norms comprise perceptual strength ratings in six perceptual modalities: audition, gustation, haptics, olfaction, vision, and interoception. The new norms improve on existing Dutch sensory norms in three ways: 1) they significantly expand on the number of words rated; 2) they include multiple word classes; 3) they add a new perceptual modality: interoception. We show that the sensory norms are able to predict word processing behavior and outperform existing ratings of sensory experience: concreteness and imageability. The data are available via the Open Science Framework ( https://osf.io/ubvy2 ) and serve as a valuable resource for research into the relationship between language and perception.

Grounding language in the neglected senses of touch, taste, and smell.

Grounded theories hold sensorimotor activation is critical to language processing. Such theories have focused predominantly on the dominant senses of sight and hearing. Relatively fewer studies have assessed mental simulation within touch, taste, and smell, even though they are critically implicated in communication for important domains, such as health and wellbeing. We review work that sheds light on whether perceptual activation from lesser studied modalities contribute to meaning in language. We critically evaluate data from behavioural, imaging, and cross-cultural studies. We conclude that evidence for sensorimotor simulation in touch, taste, and smell is weak. Comprehending language related to these senses may instead rely on simulation of emotion, as well as crossmodal simulation of the "higher" senses of vision and audition. Overall, the data suggest the need for a refinement of embodiment theories, as not all sensory modalities provide equally strong evidence for mental simulation.

Impaired Comprehension of Speed Verbs in Parkinson's Disease.

OBJECTIVES: A wealth of studies provide evidence for action simulation during language comprehension. Recent research suggests such action simulations might be sensitive to fine-grained information, such as speed. Here, we present a crucial test for action simulation of speed in language by assessing speed comprehension in patients with Parkinson's disease (PD). Based on the patients' motor deficits, we hypothesized that the speed of motion described in language would modulate their performance in semantic tasks. Specifically, they would have more difficulty processing language about relatively fast speed than language about slow speed. METHODS: We conducted a semantic similarity judgment task on fast and slow action verbs in patients with PD and age-matched healthy controls. Participants had to decide which of two verbs most closely matched a target word. RESULTS: Compared to controls, PD patients were slower making judgments about fast action verbs, but not for judgments about slow action verbs, suggesting impairment in processing language about fast action. Moreover, this impairment was specific to verbs describing fast action performed with the hand. CONCLUSIONS: Problems moving quickly lead to difficulties comprehending language about moving quickly. This study provides evidence that speed is an important part of action representations. (JINS, 2017, 23, 412-420).

Dutch modality exclusivity norms: Simulating perceptual modality in space.

Perceptual information is important for the meaning of nouns. We present modality exclusivity norms for 485 Dutch nouns rated on visual, auditory, haptic, gustatory, and olfactory associations. We found these nouns are highly multimodal. They were rated most dominant in vision, and least in olfaction. A factor analysis identified two main dimensions: one loaded strongly on olfaction and gustation (reflecting joint involvement in flavor), and a second loaded strongly on vision and touch (reflecting joint involvement in manipulable objects). In a second study, we validated the ratings with similarity judgments. As expected, words from the same dominant modality were rated more similar than words from different dominant modalities; but - more importantly - this effect was enhanced when word pairs had high modality strength ratings. We further demonstrated the utility of our ratings by investigating whether perceptual modalities are differentially experienced in space, in a third study. Nouns were categorized into their dominant modality and used in a lexical decision experiment where the spatial position of words was either in proximal or distal space. We found words dominant in olfaction were processed faster in proximal than distal space compared to the other modalities, suggesting olfactory information is mentally simulated as "close" to the body. Finally, we collected ratings of emotion (valence, dominance, and arousal) to assess its role in perceptual space simulation, but the valence did not explain the data. So, words are processed differently depending on their perceptual associations, and strength of association is captured by modality exclusivity ratings.

Mental simulation across sensory modalities predicts attractiveness of food concepts.

Concepts are grounded in mental simulation of sensory information, but the exact role it plays in everyday cognition is unknown. Here, we investigate its role in an important conceptual domain relevant for everyday behavior-food. We conducted two preregistered studies to test whether multimodal mental simulation is linked to attractiveness of food concepts. In Study 1, using the Lancaster Sensorimotor norms for a variety of concepts, we found unhealthy food concepts are more strongly associated with gustation, olfaction, and interoception than healthy food concepts. Importantly, these associations mediated the relationship between food healthiness and food attractiveness. In Study 2, we collected new sensory ratings with food words only and found unhealthy food concepts were more strongly associated with all perceptual modalities than healthy food concepts. Again, these associations mediated the relationship between healthiness and attractiveness. The mediating role of sensory associations to food attractiveness was also affected by context. Specifically, when participants thought about food in an eating context cued by verbal instruction, mediation by perceptual strength was weaker. Overall, we find multimodal sensory experience underlies people's belief that unhealthy food is more attractive than healthy food. This suggests mental simulation has an important role in goal-directed behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Lack of Visual Experience Affects Multimodal Language Production: Evidence From Congenitally Blind and Sighted People.

The human experience is shaped by information from different perceptual channels, but it is still debated whether and how differential experience influences language use. To address this, we compared congenitally blind, blindfolded, and sighted people's descriptions of the same motion events experienced auditorily by all participants (i.e., via sound alone) and conveyed in speech and gesture. Comparison of blind and sighted participants to blindfolded participants helped us disentangle the effects of a lifetime experience of being blind versus the task-specific effects of experiencing a motion event by sound alone. Compared to sighted people, blind people's speech focused more on path and less on manner of motion, and encoded paths in a more segmented fashion using more landmarks and path verbs. Gestures followed the speech, such that blind people pointed to landmarks more and depicted manner less than sighted people. This suggests that visual experience affects how people express spatial events in the multimodal language and that blindness may enhance sensitivity to paths of motion due to changes in event construal. These findings have implications for the claims that language processes are deeply rooted in our sensory experiences.

Odor-Color Associations Are Not Mediated by Concurrent Verbalization.

Odor and color are strongly associated. Numerous studies demonstrate consistent odor-color associations, as well as effects of color on odor perception and language. Yet, we know little about how these associations arise. Here, we test whether language is a possible mediator of odor-color associations, specifically whether odor-color associations are mediated by implicit odor naming. In two experiments, we used an interference paradigm to prevent the verbalization of odors during an odor-color matching task. If participants generate color associations subsequent to labeling an odor, interfering with verbalization during the task should affect the ability to make color associations. In Experiment 1, contrary to our hypothesis, verbal interference did not affect odor-color matches. However, since performance accuracy on the verbal interference task was high, it is possible our task did not sufficiently disrupt verbal processing. In Experiment 2, we, therefore, used an active verbal interference task, and still found no difference across interference conditions. Odor naming accuracy, odor familiarity, and odor pleasantness, however, did predict odor-color matches. This suggests that although color associations are related to semantic factors, they are not generated by recruiting odor labels in the moment. Overall, our results do not provide evidence that language plays an online role in odor-color associations, instead, they are consistent with the claim that language may have shaped associations during development.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language.

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Losing the sense of smell does not disrupt processing of odor words.

Whether language is grounded in action and perception has been a key question in cognitive science, yet little attention has been given to the sense of smell. We directly test whether smell is necessary for comprehension of odor language, by comparing language processing in a group of participants with no sense of smell (anosmics) to a group of control participants. We found no evidence for a difference in online comprehension of odor and taste language between anosmics and controls using a lexical decision task and a semantic similarity judgment task, suggesting olfaction is not critical to the comprehension of odor language. Contrary to predictions, anosmics were better at remembering odor words, and rated odor and taste words as more positively valenced than control participants. This study finds no detriment to odor language after losing the sense of smell, supporting the proposal that odor language is not grounded in odor perception.

Crossmodal Associations with Olfactory, Auditory, and Tactile Stimuli in Children and Adults.

People associate information with different senses but the mechanism by which this happens is unclear. Such associations are thought to arise from innate structural associations in the brain, statistical associations in the environment, via shared affective content, or through language. A developmental perspective on crossmodal associations can help determine which explanations are more likely for specific associations. Certain associations with pitch (e.g., pitch-height) have been observed early in infancy, but others may only occur late into childhood (e.g., pitch-size). In contrast, tactile-chroma associations have been observed in children, but not adults. One modality that has received little attention developmentally is olfaction. In the present investigation, we explored crossmodal associations from sound, tactile stimuli, and odor to a range of stimuli by testing a broad range of participants. Across the three modalities, we found little evidence for crossmodal associations in young children. This suggests an account based on innate structures is unlikely. Instead, the number and strength of associations increased over the lifespan. This suggests that experience plays a crucial role in crossmodal associations from sound, touch, and smell to other senses.

The Sound of Smell: Associating Odor Valence With Disgust Sounds.

Olfaction has recently been highlighted as a sense poorly connected with language. Odor is difficult to verbalize, and it has few qualities that afford mimicry by vision or sound. At the same time, emotion is thought to be the most salient dimension of an odor, and it could therefore be an olfactory dimension more easily communicated. We investigated whether sounds imitative of an innate disgust response can be associated with unpleasant odors. In two experiments, participants were asked to make a forced choice between a pseudoword including a disgust sound and a neutral pseudoword, for pleasant and unpleasant odors. Overall, participants chose more disgust pseudowords than neutral pseudowords for unpleasant odors, but this was not the case for pleasant odors. This effect was not driven by a general association between unpleasant sounds and unpleasant odors, but specifically the sounds [x/χ] and [f], thought to reflect physical responses to disgusting odors, as seen in the Polish fu! or the English ugh!. In line with growing evidence that language can encode odor, we provide the first experimental evidence for an association between the sound of a word and odor valence.

Wine experts' recognition of wine odors is not verbally mediated.

Experts have better memory for items within their domain of expertise. Critically, this does not depend on more efficient use of language. However, this conclusion is based mainly on findings from experts in visual and auditory domains. Olfactory experts constitute an interesting potential counterexample since language has been implicated to be critically involved in odor memory in previous studies. We examined the role language plays in odor recognition memory for wine experts, who typically display better wine odor memory than novices and who are also able to name odors better than lay people. This suggests wine experts' superior recognition memory for odors may be verbally mediated. In 2 experiments, recognition memory for wine odors, wine-related odors, and common odors was tested in wine experts and novices. The use of language was manipulated in Experiment 1 with an overt naming versus no-naming condition, and in Experiment 2, with a verbal interference task inhibiting covert verbalization. Across the two experiments the results showed wine experts have better recognition memory for wines, but not for wine-related or common odors, indicating their memory advantage is expertise specific. Critically, this effect was not verbally mediated, as there was no relationship between experts' ability to name wines and their memory for them. Likewise, directly inhibiting online use of verbalization did not affect memory for wine odors in experts. In sum, once expertise has been acquired, language does not play a causal role in recognition memory for odors. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Classifier categories reflect but do not affect conceptual organization.

Do we structure object-related conceptual information according to real-world sensorimotor experience, or can it also be shaped by linguistic information? This study investigates whether a feature of language coded in grammar-numeral classifiers-affects the conceptual representation of objects. We compared speakers of Mandarin (a classifier language) with speakers of Dutch (a language without classifiers) on how they judged object similarity in 4 studies. In the first 3 studies, participants had to rate how similar a target object was to 4 comparison objects, 1 of which shared a classifier with the target. Objects were presented as either words or pictures. Overall, the target object was always rated as most similar to the object with the shared classifier, but this was the case regardless of the language of the participant. In a final study using a successive pile-sorting task, we also found that the underlying object concepts were similar for speakers of Mandarin and Dutch. Speakers of a nonclassifier language are therefore sensitive to the same conceptual similarities that underlie classifier systems in a classifier language. Classifier systems may therefore reflect conceptual structure, rather than shape it. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Expertise Shapes Multimodal Imagery for Wine.

Although taste and smell seem hard to imagine, some people nevertheless report vivid imagery in these sensory modalities. We investigate whether experts are better able to imagine smells and tastes because they have learned the ability, or whether they are better imaginers in the first place, and so become experts. To test this, we first compared a group of wine experts to yoked novices using a battery of questionnaires. We show for the first time that experts report greater vividness of wine imagery, with no difference in vividness across sensory modalities. In contrast, novices had more vivid color imagery than taste or odor imagery for wines. Experts and novices did not differ on other vividness of imagery measures, suggesting a domain-specific effect of expertise. Critically, in a second study, we followed a group of students commencing a wine course and a group of matched control participants. Students and controls did not differ before the course, but after the wine course students reported more vivid wine imagery. We provide evidence that expertise improves imagery, exemplifying the extent of plasticity of cognition underlying the chemical senses.

Linguistic features of fragrances: The role of grammatical gender and gender associations.

Odors are often difficult to identify and name, which leaves them vulnerable to the influence of language. The present study tests the boundaries of the effect of language on odor cognition by examining the effect of grammatical gender. We presented participants with male and female fragrances paired with descriptions of masculine or feminine grammatical gender. In Experiment 1 we found that memory for fragrances was enhanced when the grammatical gender of a fragrance description matched the gender of the fragrance. In Experiment 2 we found memory for fragrances was affected by both grammatical gender and gender associations in fragrance descriptions - recognition memory for odors was higher when the gender was incongruent. In sum, we demonstrated that even subtle aspects of language can affect odor cognition.

Measuring Multisensory Imagery of Wine: the Vividness of Wine Imagery Questionnaire.

When we imagine objects or events, we often engage in multisensory mental imagery. Yet, investigations of mental imagery have typically focused on only one sensory modality - vision. One reason for this is that the most common tool for the measurement of imagery, the questionnaire, has been restricted to unimodal ratings of the object. We present a new mental imagery questionnaire that measures multisensory imagery. Specifically, the newly developed Vividness of Wine Imagery Questionnaire (VWIQ) measures mental imagery of wine in the visual, olfactory, and gustatory modalities. Wine is an ideal domain to explore multisensory imagery because wine drinking is a multisensory experience, it involves the neglected chemical senses (smell and taste), and provides the opportunity to explore the effect of experience and expertise on imagery (from wine novices to experts). The VWIQ questionnaire showed high internal consistency and reliability, and correlated with other validated measures of imagery. Overall, the VWIQ may serve as a useful tool to explore mental imagery for researchers, as well as individuals in the wine industry during sommelier training and evaluation of wine professionals.

High-Tempo and Stinky: High Arousal Sound-Odor Congruence Affects Product Memory.

The tendency to match different sensory modalities together can be beneficial for marketing. Here we assessed the effect of sound-odor congruence on people's attitude and memory for products of a familiar and unfamiliar brand. Participants smelled high- and low-arousal odors and then saw an advertisement for a product of a familiar or unfamiliar brand, paired with a high- or low-arousal jingle. Participants' attitude towards the advertisement, the advertised product, and the product's brand was measured, as well as memory for the product. In general, no sound-odor congruence effect was found on attitude, irrespective of brand familiarity. However, congruence was found to affect recognition: when a high-arousal odor and a high-arousal sound were combined, participants recognized products faster than in the other conditions. In addition, familiar brands were recognized faster than unfamiliar brands, but only when sound or odor arousal was high. This study provides insight into the possible applications of sound-odor congruence for marketing by demonstrating its potential to influence product memory.

Superior olfactory language and cognition in odor-color synaesthesia.

Olfaction is often considered a vestigial sense in humans, demoted throughout evolution to make way for the dominant sense of vision. This perspective on olfaction is reflected in how we think and talk about smells in the West, with odor imagery and odor language reported to be difficult. In the present study we demonstrate odor cognition is superior in odor-color synaesthesia, where there are additional sensory connections to odor concepts. Synaesthesia is a neurological phenomenon in which input in 1 modality leads to involuntary perceptual associations. Semantic accounts of synaesthesia posit synaesthetic associations are mediated by activation of inducing concepts. Therefore, synaesthetic associations may strengthen conceptual representations. To test this idea, we ran 6 odor-color synaesthetes and 17 matched controls on a battery of tasks exploring odor and color cognition. We found synaesthetes outperformed controls on tests of both odor and color discrimination, demonstrating for the first time enhanced perception in both the inducer (odor) and concurrent (color) modality. So, not only do synaesthetes have additional perceptual experiences in comparison to controls, their primary perceptual experience is also different. Finally, synaesthetes were more consistent and accurate at naming odors. We propose synaesthetic associations to odors strengthen odor concepts, making them more differentiated (facilitating odor discrimination) and easier to link with lexical representations (facilitating odor naming). In summary, we show for the first time that both odor language and perception is enhanced in people with synaesthetic associations to odors. (PsycINFO Database Record