The role of synaesthesia in reading written musical key signatures.

This study is the first empirical demonstration of synaesthesia for reading written musical keys signatures. Nine music-color synaesthetes and 9 controls took part in 5 experiments that aimed to confirm the authenticity of synaesthesia for reading musical keys, and to demonstrate that this type of synaesthesia is linked to conceptual rather than to purely perceptual processing of the inducing stimulus. First, the existence of a synaesthetic association with written musical keys was validated in an objective manner by employing 2 measures of consistency as diagnostic criteria. Second, the automaticity of the synaesthetes' responses was tested by demonstrating the presence of interference when naming synaesthetic colors for incongruent pairings of color and musical key. To test whether a change in form altered the concept of the musical key, stimuli were randomly presented in 3 separate modes (words, treble clef, or bass clef). Last, the interference of synaesthetic colors with veridical colors was assessed in a task-irrelevant manner, that is, without the need for the explicit naming of synaesthetic color. Findings showed synaesthesia for written musical keys to be a genuine form of synaesthesia elicited from the concept, or the idea, of the key. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Language evolution: examining the link between cross-modality and aggression through the lens of disorders.

We demonstrate how two linguistic phenomena, figurative language (implicating cross-modality) and derogatory language (implicating aggression), both demand a precise degree of (dis)inhibition in the same cortico-subcortical brain circuits, in particular cortico-striatal networks, whose connectivity has been significantly enhanced in recent evolution. We examine four cognitive disorders/conditions that exhibit abnormal patterns of (dis)inhibition in these networks: schizophrenia (SZ), autism spectrum disorder (ASD), synaesthesia and Tourette's syndrome (TS), with the goal of understanding why the two phenomena altered reactive aggression and altered cross-modality cluster together in these disorders. Our proposal is that enhanced cross-modality (necessary to support language, in particular metaphoricity) was a result, partly a side-effect, of self-domestication (SD). SD targeted the taming of reactive aggression, but reactive impulses are controlled by the same cortico-subcortical networks that are implicated in cross-modality. We further add that this biological process of SD did not act alone, but was engaged in an intense feedback loop with the cultural emergence of early forms of language/grammar, whose high degree of raw metaphoricity and verbal aggression also contributed to increased brain connectivity and cortical control. Consequently, in conjunction with linguistic expressions serving as approximations/'fossils' of the earliest stages of language, these cognitive disorders/conditions serve as confident proxies of brain changes in language evolution, helping us reconstruct certain crucial aspects of early prehistoric languages and cognition, as well as shed new light on the nature of the disorders. This article is part of the theme issue 'Reconstructing prehistoric languages'.

Temporal dissociation of neural activity underlying synesthetic and perceptual colors.

Grapheme-color synesthetes experience color when seeing achromatic symbols. We examined whether similar neural mechanisms underlie color perception and synesthetic colors using magnetoencephalography. Classification models trained on neural activity from viewing colored stimuli could distinguish synesthetic color evoked by achromatic symbols after a delay of ∼100 ms. Our results provide an objective neural signature for synesthetic experience and temporal evidence consistent with higher-level processing in synesthesia.

Perceptual Gains and Losses in Synesthesia and Schizophrenia.

Individual differences in perception are widespread. Considering inter-individual variability, synesthetes experience stable additional sensations; schizophrenia patients suffer perceptual deficits in, eg, perceptual organization (alongside hallucinations and delusions). Is there a unifying principle explaining inter-individual variability in perception? There is good reason to believe perceptual experience results from inferential processes whereby sensory evidence is weighted by prior knowledge about the world. Perceptual variability may result from different precision weighting of sensory evidence and prior knowledge. We tested this hypothesis by comparing visibility thresholds in a perceptual hysteresis task across medicated schizophrenia patients (N = 20), synesthetes (N = 20), and controls (N = 26). Participants rated the subjective visibility of stimuli embedded in noise while we parametrically manipulated the availability of sensory evidence. Additionally, precise long-term priors in synesthetes were leveraged by presenting either synesthesia-inducing or neutral stimuli. Schizophrenia patients showed increased visibility thresholds, consistent with overreliance on sensory evidence. In contrast, synesthetes exhibited lowered thresholds exclusively for synesthesia-inducing stimuli suggesting high-precision long-term priors. Additionally, in both synesthetes and schizophrenia patients explicit, short-term priors-introduced during the hysteresis experiment-lowered thresholds but did not normalize perception. Our results imply that perceptual variability might result from differences in the precision afforded to prior beliefs and sensory evidence, respectively.

Synesthesia, hallucination, and autism.

Synesthesia literally means a "union of the senses" whereby two or more of the five senses that are normally experienced separately are involuntarily and automatically joined together in experience (1, 2, 3). For example, some synesthetes experience a color when they hear a sound, although many instances of synesthesia also occur entirely within the visual sense. In this paper, I first mainly engage critically with Sollberger's view that there is reason to think that at least some synesthetic experiences can be viewed as truly veridical perceptions, and not as illusions or hallucinations (4). Among other things, I explore the possibility that many forms of synesthesia can be understood as experiencing what I will call "second-order secondary properties," that is, experiences of properties of objects induced by the secondary qualities of those objects. In doing so, I shed some light on why synesthesia is typically one-directional and its relation to some psychopathologies such as autism.

Olfactory-colour crossmodal correspondences in art, science, and design.

The last few years have seen a rapid growth of interest amongst researchers in the crossmodal correspondences. One of the correspondences that has long intrigued artists is the putative association between colours and odours. While traditionally conceptualised in terms of synaesthesia, over the last quarter century or so, at least 20 published peer-reviewed articles have assessed the consistent, and non-random, nature of the colours that people intuitively associate with specific (both familiar and unfamiliar) odours in a non-food context. Having demonstrated such consistent mappings amongst the general (i.e. non-synaesthetic) population, researchers have now started to investigate whether they are shared cross-culturally, and to document their developmental acquisition. Over the years, several different explanations have been put forward by researchers for the existence of crossmodal correspondences, including the statistical, semantic, structural, and emotional-mediation accounts. While several of these approaches would appear to have some explanatory validity as far as the odour-colour correspondences are concerned, contemporary researchers have focussed on learned associations as the dominant explanatory framework. The nature of the colour-odour associations that have been reported to date appear to depend on the familiarity of the odour and the ease of source naming, and hence the kind of association/representation that is accessed. While the bidirectionality of odour-colour correspondences has not yet been rigorously assessed, many designers are nevertheless already starting to build on odour-colour crossmodal correspondences in their packaging/labelling/branding work.

Association between synesthetic colors and sensitivity to physical colors changed by type of synesthetic experience in grapheme-color synesthesia.

Grapheme-color synesthesia is a condition in which visual perception of letters induces simultaneous perception of a specific color. Previous studies indicate that grapheme-color synesthetes are more sensitive to physical colors than non-synesthetes. Synesthetic colors are found to be concentrated in multiple regions of the color space, forming "synesthetic color clusters". The present study investigated whether color sensitivity corresponding to synesthetic color clusters (clustered colors) is higher than color sensitivity that does not correspond to synesthetic color clusters (non-clustered colors). However, we found no difference in the color sensitivity for clustered and non-clustered colors. We also investigated whether the color sensitivity is dependent on the synesthetic experience (associators and projectors). We found that the greater the tendency toward associator characteristics, the greater the sensitivity for clustered colors compared to that for non-clustered colors. Our findings suggest an association between synesthetic colors and physical color sensitivity that is modulated by synesthetic experience.

Synesthesia in children with difficulties in written language learning.

We tested whether the acquisition of grapheme-color synesthesia during childhood is related to difficulties in written language learning by measuring whether it is more frequent in 79 children receiving speech and language therapy for such difficulties than in the general population of children (1.3%). By using criteria as similar as possible to those used in the reference study (Simner et al., 2009), we did not identify any synesthete (Bayesian 95% credible interval [0, 4.5]% for a flat prior). The odds of the null model (no difference between 0/79 and 1.3%) over alternative models is 28 (Bayes Factor). A higher prevalence of grapheme-color synesthetes among children with learning difficulties is therefore very unlikely, questioning the hypothesis of a link between synesthesia and difficulties in language acquisition. We also describe the difficulty of diagnosing synesthesia in children and discuss the need for new approaches to do so.

Reduced perceptual narrowing in synesthesia.

Synesthesia is a neurologic trait in which specific inducers, such as sounds, automatically elicit additional idiosyncratic percepts, such as color (thus "colored hearing"). One explanation for this trait-and the one tested here-is that synesthesia results from unusually weak pruning of cortical synaptic hyperconnectivity during early perceptual development. We tested the prediction from this hypothesis that synesthetes would be superior at making discriminations from nonnative categories that are normally weakened by experience-dependent pruning during a critical period early in development-namely, discrimination among nonnative phonemes (Hindi retroflex /d̪a/ and dental /ɖa/), among chimpanzee faces, and among inverted human faces. Like the superiority of 6-mo-old infants over older infants, the synesthetic groups were significantly better than control groups at making all the nonnative discriminations across five samples and three testing sites. The consistent superiority of the synesthetic groups in making discriminations that are normally eliminated during infancy suggests that residual cortical connectivity in synesthesia supports changes in perception that extend beyond the specific synesthetic percepts, consistent with the incomplete pruning hypothesis.

A single system account of enhanced recognition memory in synaesthesia.

Researchers often adjudicate between models of memory according to the models' ability to explain impaired patterns of performance (e.g., in amnesia). In contrast, evidence from special groups with enhanced memory is very rarely considered. Here, we explored how people with unusual perceptual experiences (synaesthesia) perform on various measures of memory and test how computational models of memory may account for their enhanced performance. We contrasted direct and indirect measures of memory (i.e., recognition memory, repetition priming, and fluency) in grapheme-colour synaesthetes and controls using a continuous identification with recognition (CID-R) paradigm. Synaesthetes outperformed controls on recognition memory and showed a different reaction-time pattern for identification. The data were most parsimoniously accounted for by a single-system computational model of the relationship between recognition and identification. Overall, the findings speak in favour of enhanced processing as an explanation for the memory advantage in synaesthesia. In general, our results show how synaesthesia can be used as an effective tool to study how individual differences in perception affect cognitive functions.

Substantiating synesthesia: a novel aid in a case of grapheme-colour synesthesia and concomitant dyscalculia.

Here we present the case of SP, a 21-year-old female with life-long dyscalculia. SP was subsequently diagnosed with grapheme-color synesthesia, a diagnosis that serendipitously catalyzed our development of a novel aid:The digit-color calculator (DCC). The DCC substantiates SP's color concurrents, dramatically ameliorating her difficulties with basic calculations. We envisage the DCC and its analogues may assist others in educational settings, particularly if they experience difficulties with the acquisition of literacy and numeracy. Further devices that leverage synesthesia may also have the potential to improve the quality of life for others with trait synesthesia regardless of concomitant disorder.

Constructing calendars in the brain.

By studying an enigmatic condition called, "calendar synesthesia", we explored the elusive boundary between perception, visual imagery, and the manner in which we construct an internal mental calendar by mapping time-sequences onto spatial maps. We use a series of demonstrations to establish that these calendars act more like real objects activating sensory pathways rather than purely abstract symbolic descriptions that bear no resemblance to an actual calendar. We propose that the calendar is enshrined in acircuitry involving the hippocampal place-cells and entorhinal grid-cells, which are connected to the angular gyrus (involved with computing sequences) via the inferior longitudinal fasciculus.

Synaesthesia: a distinct entity that is an emergent feature of adaptive neurocognitive differences.

In this article, I argue that synaesthesia is not on a continuum with neurotypical cognition. Synaesthesia is special: its phenomenology is different; it has distinct causal mechanisms; and is likely to be associated with a distinct neurocognitive profile. However, not all synaesthetes are the same, and there are quantifiable differences between them. In particular, the number of types of synaesthesia that a person possesses is a hitherto underappreciated variable that predicts cognitive differences along a number of dimensions (mental imagery, sensory sensitivity, attention to detail). Together with enhanced memory, this may constitute a common core of abilities that may go some way to explaining why synaesthesia might have evolved. I argue that the direct benefits of synaesthesia are generally limited (i.e. the synaesthetic associations do not convey novel information about the world) but, nevertheless, synaesthesia may develop due to other adaptive functions (e.g. perceptual ability, memory) that necessitate changes to design features of the brain. The article concludes by suggesting that synaesthesia forces us to reconsider what we mean by a 'normal' mind/brain. There may be multiple 'normal' neurodevelopmental trajectories that can sculpt very different ways of experiencing the world, of which synaesthesia is but one. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

How non-veridical perception drives actions in healthy humans: evidence from synaesthesia.

We continually perform actions that are driven by our perception and it is a commonly held view that only objectively perceived changes within the 'real' world affect behaviour. Exceptions are generally only made for mental health disorders associated with delusions and hallucinations where behaviour may be triggered by the experience of objectively non-existent percepts. Here, we demonstrate, using synaesthesia as a model condition (in N = 19 grapheme-colour synaesthetes), how objectively non-existent (i.e. non-veridical) but still non-pathological perceptions affect actions in healthy humans. Using electroencephalography, we determine whether early-stage perceptual processes (reflected by P1 and N1 event-related potential (ERP) components), or late-stage-integration processes (reflected by N2 component), underlie the effects of non-veridical perceptions on action control. ERP analysis suggests that even though the examined peculiarities and experimental variations are perceptual in nature, it is not early-stage perceptual processes, but rather higher-order executive control processes linking perceptions to the appropriate motor response underlying this effect. Source localization analysis implicates activation within medial frontal cortices in the effect of how irrelevant non-veridical perceptions modulate behaviour. Our results challenge common conceptions about the determinants of human behaviour but can be explained by well-established theoretical frameworks detailing the link between perception and action. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Neurophenomenology of induced and natural synaesthesia.

People with synaesthesia have additional perceptual experiences, which are automatically and consistently triggered by specific inducing stimuli. Synaesthesia therefore offers a unique window into the neurocognitive mechanisms underlying conscious perception. A long-standing question in synaesthesia research is whether it is possible to artificially induce non-synaesthetic individuals to have synaesthesia-like experiences. Although synaesthesia is widely considered a congenital condition, increasing evidence points to the potential of a variety of approaches to induce synaesthesia-like experiences, even in adulthood. Here, we summarize a range of methods for artificially inducing synaesthesia-like experiences, comparing the resulting experiences to the key hallmarks of natural synaesthesia which include consistency, automaticity and a lack of 'perceptual presence'. We conclude that a number of aspects of synaesthesia can be artificially induced in non-synaesthetes. These data suggest the involvement of developmental and/or learning components in the acquisition of synaesthesia, and they extend previous reports of perceptual plasticity leading to dramatic changes in perceptual phenomenology in adults. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Implicit and explicit spatial-numerical representations diverge in number-form synesthetes.

In number-form (NF) synesthesia-a condition in which people report vivid, automatic and consistent mental layouts for numerical sequences-numbers and space are closely linked. These explicit associations are similar to the implicit associations demonstrated by the Spatial-Numerical Association of Response Codes (SNARC) effect. Thus, NF synesthesia offers a unique opportunity to investigate spatial-numerical associations. We tested implicit and explicit representations in NF synesthetes using a multiple case-study design. Over two sessions, synesthetes participated in a semi-structured interview focusing on the nature of their associations, as well as SNARC and number line estimation tasks. Contrary to our hypotheses, only one synesthete demonstrated SNARC effects congruent with her reported form, whereas two others exhibited SNARC effects that were the opposite of their explicit NFs. While this inconsistency between implicit and explicit representations may indicate separate underlying cognitive mechanisms, factors such as task-specific constraints and strategic variability must also be considered.

Development of synaesthetic consistency: Repeated autonomous engagement with graphemes and colours leads to consistent associations.

Synaesthetic consistency is the hallmark of synaesthesia and plays an important role in the definition and validation of synaesthesia. It has been hypothesised that the acquisition of initially unspecified synaesthetic associations is based on consolidation processes. Thus, we investigated in non-synaesthetes whether repeatedly engaging with grapheme-colour associations mimics the developmental trajectory of synaesthetic consistency in genuine grapheme-colour synaesthesia. This was the case for the two tested experimental groups, irrespective of whether they were instructed to memorize their chosen associations, but not for the passive control group. Moreover, consolidated associations of the experimental groups resembled those frequently found in genuine synaesthesia. Furthermore, the acquisition of consistent grapheme-colour associations resulted in a transfer of benefits to performance in recognition memory for abstract stimuli, as also found in genuine synaesthesia. Our findings suggest that consistent synaesthetic associations are based on consolidation processes due to repeated engagement with graphemes and colours.

On the Relative Nature of (Pitch-Based) Crossmodal Correspondences.

This review deals with the question of the relative vs absolute nature of crossmodal correspondences, with a specific focus on those correspondences involving the auditory dimension of pitch. Crossmodal correspondences have been defined as the often-surprising crossmodal associations that people experience between features, attributes, or dimensions of experience in different sensory modalities, when either physically present, or else merely imagined. In the literature, crossmodal correspondences have often been contrasted with synaesthesia in that the former are frequently said to be relative phenomena (e.g., it is the higher-pitched of two sounds that is matched with the smaller of two visual stimuli, say, rather than there being a specific one-to-one crossmodal mapping between a particular pitch of sound and size of object). By contrast, in the case of synaesthesia, the idiosyncratic mapping between inducer and concurrent tends to be absolute (e.g., it is a particular sonic inducer that elicits a specific colour concurrent). However, a closer analysis of the literature soon reveals that the distinction between relative and absolute in the case of crossmodal correspondences may not be as clear-cut as some commentators would have us believe. Furthermore, it is important to note that the relative vs absolute question may receive different answers depending on the particular (class of) correspondence under empirical investigation.