The advantage of being a synesthete: The behavioral benefits of ticker-tape synesthesia.

As first described by Francis Galton, some persons perceive vividly and automatically in their mind's eye the written form of words that they are hearing. This phenomenon, labeled ticker-tape synesthesia (TTS), is thought to reflect an abnormally strong influence of speech processing in language areas on to orthographic representations in the visual cortex. Considering the relevance of TTS for the study of reading acquisition, we looked for objective behavioral advantages or impairments in 22 synesthetes, as compared to 22 matched control participants. In three auditory tasks relying on orthographic working memory (letters counting, backward spelling, and letter shape decision), we predicted and observed better performance in synesthetes than in controls. In two visual tasks (lexical decision and letter decision) with a concurrent auditory stimulation, we predicted that synesthetes should suffer from a larger interference by irrelevant speech than controls, but eventually found no difference between the groups. Those results, which we discuss in relation to orthographic processing, mental imagery, and working memory, promote TTS from pure subjectivity to an experimentally measurable phenomenon.

Exploring the anatomical encoding of voice with a mathematical model of the vocal system.

The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.

Probing ERP correlates of verbal semantic processing in patients with impaired consciousness.

Our ability to identify covert cognitive abilities in non-communicating patients is of prime importance to improve diagnosis, to guide therapeutic decisions and to better predict their cognitive outcome. In the present study, we used a basic and rigorous paradigm contrasting pairs of words orthogonally. This paradigm enables the probing of semantic processing by comparing neural activity elicited by similar words delivered in various combinations. We describe the respective timing, topography and estimated cortical sources of two successive event-related potentials (ERP) components (N400 and late positive component (LPC)) using high-density EEG in conscious controls (N=20) and in minimally conscious (MCS; N=15) and vegetative states (VS; N=15) patients recorded at bedside. Whereas N400-like ERP components could be observed in the VS, MCS and conscious groups, only MCS and conscious groups showed a LPC response, suggesting that this late effect could be a potential specific marker of conscious semantic processing. This result is coherent with recent findings disentangling early and local non-conscious responses (e.g.: MMN in odd-ball paradigms, N400 in semantic violation paradigms) from late, distributed and conscious responses (e.g.: P3b to auditory rule violation) in controls and in patients with disorders of consciousness. However, N400 and LPC responses were not easily observed at the individual level, - even in conscious controls - , with standard ERP analyses, which is a limiting factor for its clinical use. Of potential interest, the only 3 patients presenting both significant N400 and LPC effects were MCS, and 2 of them regained consciousness and functional language abilities.

Event-Related Potential, Time-frequency, and Functional Connectivity Facets of Local and Global Auditory Novelty Processing: An Intracranial Study in Humans.

Auditory novelty detection has been associated with different cognitive processes. Bekinschtein et al. (2009) developed an experimental paradigm to dissociate these processes, using local and global novelty, which were associated, respectively, with automatic versus strategic perceptual processing. They have mostly been studied using event-related potentials (ERPs), but local spiking activity as indexed by gamma (60-120 Hz) power and interactions between brain regions as indexed by modulations in beta-band (13-25 Hz) power and functional connectivity have not been explored. We thus recorded 9 epileptic patients with intracranial electrodes to compare the precise dynamics of the responses to local and global novelty. Local novelty triggered an early response observed as an intracranial mismatch negativity (MMN) contemporary with a strong power increase in the gamma band and an increase in connectivity in the beta band. Importantly, all these responses were strictly confined to the temporal auditory cortex. In contrast, global novelty gave rise to a late ERP response distributed across brain areas, contemporary with a sustained power decrease in the beta band (13-25 Hz) and an increase in connectivity in the alpha band (8-13 Hz) within the frontal lobe. We discuss these multi-facet signatures in terms of conscious access to perceptual information.

Reading with sounds: sensory substitution selectively activates the visual word form area in the blind.

Using a visual-to-auditory sensory-substitution algorithm, congenitally fully blind adults were taught to read and recognize complex images using "soundscapes"--sounds topographically representing images. fMRI was used to examine key questions regarding the visual word form area (VWFA): its selectivity for letters over other visual categories without visual experience, its feature tolerance for reading in a novel sensory modality, and its plasticity for scripts learned in adulthood. The blind activated the VWFA specifically and selectively during the processing of letter soundscapes relative to both textures and visually complex object categories and relative to mental imagery and semantic-content controls. Further, VWFA recruitment for reading soundscapes emerged after 2 hr of training in a blind adult on a novel script. Therefore, the VWFA shows category selectivity regardless of input sensory modality, visual experience, and long-term familiarity or expertise with the script. The VWFA may perform a flexible task-specific rather than sensory-specific computation, possibly linking letter shapes to phonology.

Event related potentials elicited by violations of auditory regularities in patients with impaired consciousness.

Improving our ability to detect conscious processing in non communicating patients remains a major goal of clinical cognitive neurosciences. In this perspective, several functional brain imaging tools are currently under development. Bedside cognitive event-related potentials (ERPs) derived from the EEG signal are a good candidate to explore consciousness in these patients because: (1) they have an optimal time resolution within the millisecond range able to monitor the stream of consciousness, (2) they are fully non-invasive and relatively cheap, (3) they can be recorded continuously on dedicated individual systems to monitor consciousness and to communicate with patients, (4) and they can be used to enrich patients' autonomy through brain-computer interfaces. We recently designed an original auditory rule extraction ERP test that evaluates cerebral responses to violations of temporal regularities that are either local in time or global across several seconds. Local violations led to an early response in auditory cortex, independent of attention or the presence of a concurrent visual task, while global violations led to a late and spatially distributed response that was only present when subjects were attentive and aware of the violations. In the present work, we report the results of this test in 65 successive recordings obtained at bedside from 49 non-communicating patients affected with various acute or chronic neurological disorders. At the individual level, we confirm the high specificity of the 'global effect': only conscious patients presented this proposed neural signature of conscious processing. Here, we also describe in details the respective neural responses elicited by violations of local and global auditory regularities, and we report two additional ERP effects related to stimuli expectancy and to task learning, and we discuss their relations to consciousness.

Probing the lifetimes of auditory novelty detection processes.

Auditory novelty detection can be fractionated into multiple cognitive processes associated with their respective neurophysiological signatures. In the present study we used high-density scalp event-related potentials (ERPs) during an active version of the auditory oddball paradigm to explore the lifetimes of these processes by varying the stimulus onset asynchrony (SOA). We observed that early MMN (90-160 ms) decreased when the SOA increased, confirming the evanescence of this echoic memory system. Subsequent neural events including late MMN (160-220 ms) and P3a/P3b components of the P3 complex (240-500 ms) did not decay with SOA, but showed a systematic delay effect supporting a two-stage model of accumulation of evidence. On the basis of these observations, we propose a distinction within the MMN complex of two distinct events: (1) an early, pre-attentive and fast-decaying MMN associated with generators located within superior temporal gyri (STG) and frontal cortex, and (2) a late MMN more resistant to SOA, corresponding to the activation of a distributed cortical network including fronto-parietal regions.

Neural signature of the conscious processing of auditory regularities.

Can conscious processing be inferred from neurophysiological measurements? Some models stipulate that the active maintenance of perceptual representations across time requires consciousness. Capitalizing on this assumption, we designed an auditory paradigm that evaluates cerebral responses to violations of temporal regularities that are either local in time or global across several seconds. Local violations led to an early response in auditory cortex, independent of attention or the presence of a concurrent visual task, whereas global violations led to a late and spatially distributed response that was only present when subjects were attentive and aware of the violations. We could detect the global effect in individual subjects using functional MRI and both scalp and intracerebral event-related potentials. Recordings from 8 noncommunicating patients with disorders of consciousness confirmed that only conscious individuals presented a global effect. Taken together these observations suggest that the presence of the global effect is a signature of conscious processing, although it can be absent in conscious subjects who are not aware of the global auditory regularities. This simple electrophysiological marker could thus serve as a useful clinical tool.