Bimodal Stimulation for the Reduction of Tinnitus Using Vibration on the Skin.

Tinnitus (ringing in the ears) affects 1 in 10 adults in the United States, often with damaging psychological consequences. Currently, there exists no cure for most forms of tinnitus. Recently, bimodal stimulation - the pairing of sounds with haptic stimulation - has shown efficacy in reducing the symptoms of tinnitus. Previous bimodal stimulation approaches have used electrical shocks on the tongue, a technique that requires daily in-person sessions at an audiologist's office. We here show that excellent results can be achieved wearing a wristband with multiple vibratory motors. Tones are played and the wristband correspondingly vibrates the wrist of the user at different spatial locations depending on the frequency of the tone. We compared the experimental group with a control group who listened to the tones but did not wear the wristband. The tone frequencies were centered on each user's tinnitus frequency and the tones were randomized both in frequency and duration. 45 participants with Tinnitus Functional Index (TFI) scores of 25 and above were tested. Results show a significantly greater reduction in TFI scores for the experimental group compared to the control. Importantly, with higher baseline severity we find larger differences between the experimental and control groups, revealing greater symptom improvement for those with severe tinnitus. The therapeutic approach of combining sounds with spatiallyand temporally-correlated vibrations on the wrist is found to be a simple, time-efficient, and effective procedure to lessen the symptoms of tinnitus.

A call for comparing theories of consciousness and data sharing.

Merker, Williford, and Rudrauf make several arguments against the integrated information theory of consciousness; whereas some have merit, their conclusion that the theory should be discarded is premature. Coming years promise advances in the empirical study of consciousness, and only after theories are independently tested with shared data can they be ruled in or out. We propose future research directions.

The prevalence of synaesthesia depends on early language learning.

According to one theory, synaesthesia develops, or is preserved, because it helps children learn. If so, it should be more common among adults who faced greater childhood learning challenges. In the largest survey of synaesthesia to date, the incidence of synaesthesia was compared among native speakers of languages with transparent (easier) and opaque (more difficult) orthographies. Contrary to our prediction, native speakers of Czech (transparent) were more likely to be synaesthetes than native speakers of English (opaque). However, exploratory analyses suggested that this was because more Czechs learned non-native second languages, which was strongly associated with synaesthesia, consistent with the learning hypothesis. Furthermore, the incidence of synaesthesia among speakers of opaque languages was double that among speakers of transparent languages other than Czech, also consistent with the learning hypothesis. These findings contribute to an emerging understanding of synaesthetic development as a complex and lengthy process with multiple causal influences.

Using space and time to encode vibrotactile information: toward an estimate of the skin's achievable throughput.

Touch receptors in the skin can relay various forms of abstract information, such as words (Braille), haptic feedback (cell phones, game controllers, feedback for prosthetic control), and basic visual information such as edges and shape (sensory substitution devices). The skin can support such applications with ease: They are all low bandwidth and do not require a fine temporal acuity. But what of high-throughput applications? We use sound-to-touch conversion as a motivating example, though others abound (e.g., vision, stock market data). In the past, vibrotactile hearing aids have demonstrated improvement in speech perceptions in the deaf. However, a sound-to-touch sensory substitution device that works with high efficacy and without the aid of lipreading has yet to be developed. Is this because skin simply does not have the capacity to effectively relay high-throughput streams such as sound? Or is this because the spatial and temporal properties of skin have not been leveraged to full advantage? Here, we begin to address these questions with two experiments. First, we seek to determine the best method of relaying information through the skin using an identification task on the lower back. We find that vibrotactile patterns encoding information in both space and time yield the best overall information transfer estimate. Patterns encoded in space and time or "intensity" (the coupled coding of vibration frequency and force) both far exceed performance of only spatially encoded patterns. Next, we determine the vibrotactile two-tacton resolution on the lower back-the distance necessary for resolving two vibrotactile patterns. We find that our vibratory motors conservatively require at least 6 cm of separation to resolve two independent tactile patterns (>80 % correct), regardless of stimulus type (e.g., spatiotemporal "sweeps" versus single vibratory pulses). Six centimeter is a greater distance than the inter-motor distances used in Experiment 1 (2.5 cm), which explains the poor identification performance of spatially encoded patterns. Hence, when using an array of vibrational motors, spatiotemporal sweeps can overcome the limitations of vibrotactile two-tacton resolution. The results provide the first steps toward obtaining a realistic estimate of the skin's achievable throughput, illustrating the best ways to encode data to the skin (using as many dimensions as possible) and how far such interfaces would need to be separated if using multiple arrays in parallel.

Perceived duration is reduced by repetition but not by high-level expectation.

A repeated stimulus is judged as briefer than a novel one. It has been suggested that this duration illusion is an example of a more general phenomenon-namely that a more expected stimulus is judged as briefer than a less expected one. To test this hypothesis, we manipulated high-level expectation through the probability of a stimulus sequence, through the regularity of the preceding stimuli in a sequence, or through whether a stimulus violates an overlearned sequence. We found that perceived duration is not reduced by these types of expectation. Repetition of stimuli, on the other hand, consistently reduces perceived duration across our experiments. In addition, the effect of stimulus repetition is constrained to the location of the repeated stimulus. Our findings suggest that estimates of subsecond duration are largely the result of low-level sensory processing.

Why public dissemination of science matters: a manifesto.

Communicating science to the public takes time away from busy research careers. So why would you do it? I here offer six reasons. First, we owe that understanding to the people who fund our experiments, the taxpaying public. Second, we can leverage our skills as scientists to inspire critical thinking in public and political dialog. Third, researchers are optimally positioned to stem the flow of scientific misinformation in the media. Fourth, we can explain the ways and the means by which science can (and cannot) improve law and social policy. Fifth, it is incumbent upon us to explain what science is and is not: while it is a way of thinking that upgrades our intuitions, it also comes with a deep understanding of (and tolerance for) uncertainty. Finally, we find ourselves in the pleasurable position of being able to share the raw beauty of the world around us-and in the case of neuroscience, the world inside us. I suggest that scientists are optimally stationed to increase their presence in the public sphere: our training positions us to synthesize large bodies of data, weigh the evidence, and communicate with nuance, sincerity and exactitude.

Neural networks of colored sequence synesthesia.

Synesthesia is a condition in which normal stimuli can trigger anomalous associations. In this study, we exploit synesthesia to understand how the synesthetic experience can be explained by subtle changes in network properties. Of the many forms of synesthesia, we focus on colored sequence synesthesia, a form in which colors are associated with overlearned sequences, such as numbers and letters (graphemes). Previous studies have characterized synesthesia using resting-state connectivity or stimulus-driven analyses, but it remains unclear how network properties change as synesthetes move from one condition to another. To address this gap, we used functional MRI in humans to identify grapheme-specific brain regions, thereby constructing a functional "synesthetic" network. We then explored functional connectivity of color and grapheme regions during a synesthesia-inducing fMRI paradigm involving rest, auditory grapheme stimulation, and audiovisual grapheme stimulation. Using Markov networks to represent direct relationships between regions, we found that synesthetes had more connections during rest and auditory conditions. We then expanded the network space to include 90 anatomical regions, revealing that synesthetes tightly cluster in visual regions, whereas controls cluster in parietal and frontal regions. Together, these results suggest that synesthetes have increased connectivity between grapheme and color regions, and that synesthetes use visual regions to a greater extent than controls when presented with dynamic grapheme stimulation. These data suggest that synesthesia is better characterized by studying global network dynamics than by individual properties of a single brain region.

Synaesthesia in Chinese characters: the role of radical function and position.

Grapheme-colour synaesthetes experience unusual colour percepts when they encounter letters and/or digits. Studies of English-speaking grapheme-colour synaesthetes have shown that synaesthetic colours are sometimes triggered by rule-based linguistic mechanisms (e.g., B might be blue). In contrast, little is known about synaesthesia in logographic languages such as Chinese. The current study shows the mechanisms by which synaesthetic speakers of Chinese colour their language. One hypothesis is that Chinese characters might be coloured by their constituent morphological units, known as radicals, and we tested this by eliciting synaesthetic colours for characters while manipulating features of the radicals within them. We found that both the function (semantic vs. phonetic) and position (left vs. right) of radicals influence the nature of the synaesthetic colour generated. Our data show that in Chinese, as in English, synaesthetic colours are influenced by systematic rules, rather than by random associations, and that these rules are based on existing psycholinguistic mechanisms of language processing.

Cross-Modal Sensory Boosting to Improve High-Frequency Hearing Loss: Device Development and Validation.

Background: High-frequency hearing loss is one of the most common problems in the aging population and with those who have a history of exposure to loud noises. This type of hearing loss can be frustrating and disabling, making it difficult to understand speech communication and interact effectively with the world. Objective: This study aimed to examine the impact of spatially unique haptic vibrations representing high-frequency phonemes on the self-perceived ability to understand conversations in everyday situations. Methods: To address high-frequency hearing loss, a multi-motor wristband was developed that uses machine learning to listen for specific high-frequency phonemes. The wristband vibrates in spatially unique locations to represent which phoneme was present in real time. A total of 16 participants with high-frequency hearing loss were recruited and asked to wear the wristband for 6 weeks. The degree of disability associated with hearing loss was measured weekly using the Abbreviated Profile of Hearing Aid Benefit (APHAB). Results: By the end of the 6-week study, the average APHAB benefit score across all participants reached 12.39 points, from a baseline of 40.32 to a final score of 27.93 (SD 13.11; N=16; P=.002, 2-tailed dependent t test). Those without hearing aids showed a 10.78-point larger improvement in average APHAB benefit score at 6 weeks than those with hearing aids (t14=2.14; P=.10, 2-tailed independent t test). The average benefit score across all participants for ease of communication was 15.44 (SD 13.88; N=16; P<.001, 2-tailed dependent t test). The average benefit score across all participants for background noise was 10.88 (SD 17.54; N=16; P=.03, 2-tailed dependent t test). The average benefit score across all participants for reverberation was 10.84 (SD 16.95; N=16; P=.02, 2-tailed dependent t test). Conclusions: These findings show that vibrotactile sensory substitution delivered by a wristband that produces spatially distinguishable vibrations in correspondence with high-frequency phonemes helps individuals with high-frequency hearing loss improve their perceived understanding of verbal communication. Vibrotactile feedback provides benefits whether or not a person wears hearing aids, albeit in slightly different ways. Finally, individuals with the greatest perceived difficulty understanding speech experienced the greatest amount of perceived benefit from vibrotactile feedback.

Pathways to seeing music: enhanced structural connectivity in colored-music synesthesia.

Synesthesia, a condition in which a stimulus in one sensory modality consistently and automatically triggers concurrent percepts in another modality, provides a window into the neural correlates of cross-modal associations. While research on grapheme-color synesthesia has provided evidence for both hyperconnectivity-hyperbinding and disinhibited feedback as potential underlying mechanisms, less research has explored the neuroanatomical basis of other forms of synesthesia. In the current study we investigated the white matter correlates of colored-music synesthesia. As these synesthetes report seeing colors upon hearing musical sounds, we hypothesized that they might show unique patterns of connectivity between visual and auditory association areas. We used diffusion tensor imaging to trace the white matter tracts in temporal and occipital lobe regions in 10 synesthetes and 10 matched non-synesthete controls. Results showed that synesthetes possessed hemispheric patterns of fractional anisotropy, an index of white matter integrity, in the inferior fronto-occipital fasciculus (IFOF), a major white matter pathway that connects visual and auditory association areas to frontal regions. Specifically, white matter integrity within the right IFOF was significantly greater in synesthetes than controls. Furthermore, white matter integrity in synesthetes was correlated with scores on audiovisual tests of the Synesthesia Battery, especially in white matter underlying the right fusiform gyrus. Our findings provide the first evidence of a white matter substrate of colored-music synesthesia, and suggest that enhanced white matter connectivity is involved in enhanced cross-modal associations.

Ready...go: Amplitude of the FMRI signal encodes expectation of cue arrival time.

What happens when the brain awaits a signal of uncertain arrival time, as when a sprinter waits for the starting pistol? And what happens just after the starting pistol fires? Using functional magnetic resonance imaging (fMRI), we have discovered a novel correlate of temporal expectations in several brain regions, most prominently in the supplementary motor area (SMA). Contrary to expectations, we found little fMRI activity during the waiting period; however, a large signal appears after the "go" signal, the amplitude of which reflects learned expectations about the distribution of possible waiting times. Specifically, the amplitude of the fMRI signal appears to encode a cumulative conditional probability, also known as the cumulative hazard function. The fMRI signal loses its dependence on waiting time in a "countdown" condition in which the arrival time of the go cue is known in advance, suggesting that the signal encodes temporal probabilities rather than simply elapsed time. The dependence of the signal on temporal expectation is present in "no-go" conditions, demonstrating that the effect is not a consequence of motor output. Finally, the encoding is not dependent on modality, operating in the same manner with auditory or visual signals. This finding extends our understanding of the relationship between temporal expectancy and measurable neural signals.

The future of sensory substitution, addition, and expansion via haptic devices.

Haptic devices use the sense of touch to transmit information to the nervous system. As an example, a sound-to-touch device processes auditory information and sends it to the brain via patterns of vibration on the skin for people who have lost hearing. We here summarize the current directions of such research and draw upon examples in industry and academia. Such devices can be used for sensory substitution (replacing a lost sense, such as hearing or vision), sensory expansion (widening an existing sensory experience, such as detecting electromagnetic radiation outside the visible light spectrum), and sensory addition (providing a novel sense, such as magnetoreception). We review the relevant literature, the current status, and possible directions for the future of sensory manipulation using non-invasive haptic devices.

Larger visual changes compress time: The inverted effect of asemantic visual features on interval time perception.

Time perception is fluid and affected by manipulations to visual inputs. Previous literature shows that changes to low-level visual properties alter time judgments at the millisecond-level. At longer intervals, in the span of seconds and minutes, high-level cognitive effects (e.g., emotions, memories) elicited by visual inputs affect time perception, but these effects are confounded with semantic information in these inputs, and are therefore challenging to measure and control. In this work, we investigate the effect of asemantic visual properties (pure visual features devoid of emotional or semantic value) on interval time perception. Our experiments were conducted with binary and production tasks in both conventional and head-mounted displays, testing the effects of four different visual features (spatial luminance contrast, temporal frequency, field of view, and visual complexity). Our results reveal a consistent pattern: larger visual changes all shorten perceived time in intervals of up to 3min, remarkably contrary to their effect on millisecond-level perception. Our findings may help alter participants' time perception, which can have broad real-world implications.

Neural correlates of subsecond time distortion in the middle temporal area of visual cortex.

How does the brain represent the passage of time at the subsecond scale? Although different conceptual models for time perception have been proposed, its neurophysiological basis remains unknown. We took advantage of a visual duration illusion produced by stimulus novelty to link changes in cortical activity in monkeys with distortions of duration perception in humans. We found that human subjects perceived the duration of a subsecond motion pulse with a novel direction longer than a motion pulse with a repeated direction. Recording from monkeys viewing identical motion stimuli but performing a different behavioral task, we found that both the duration and amplitude of the neural response in the middle temporal area of visual cortex were positively correlated with the degree of novelty of the motion direction. In contrast to previous accounts that attribute distortions in duration perception to changes in the speed of a putative internal clock, our results suggest that the known adaptive properties of neural activity in visual cortex contributes to subsecond temporal distortions.

The Defensive Activation Theory: REM Sleep as a Mechanism to Prevent Takeover of the Visual Cortex.

Regions of the brain maintain their territory with continuous activity: if activity slows or stops (e.g., because of blindness), the territory tends to be taken over by its neighbors. A surprise in recent years has been the speed of takeover, which is measurable within an hour. These findings lead us to a new hypothesis on the origin of REM sleep. We hypothesize that the circuitry underlying REM sleep serves to amplify the visual system's activity periodically throughout the night, allowing it to defend its territory against takeover from other senses. We find that measures of plasticity across 25 species of primates correlate positively with the proportion of rapid eye movement (REM) sleep. We further find that plasticity and REM sleep increase in lockstep with evolutionary recency to humans. Finally, our hypothesis is consistent with the decrease in REM sleep and parallel decrease in neuroplasticity with aging.

Deciphering Sounds Through Patterns of Vibration on the Skin.

Sensory substitution refers to the concept of feeding information to the brain via an atypical sensory pathway. We here examined the degree to which participants (deaf and hard of hearing) can learn to identify sounds that are algorithmically translated into spatiotemporal patterns of vibration on the skin of the wrist. In a three-alternative forced choice task, participants could determine the identity of up to 95% and on average 70% of the stimuli simply by the spatial pattern of vibrations on the skin. Performance improved significantly over the course of 1 month. Younger participants tended to score better, possibly because of higher brain plasticity, more sensitive skin, or better skills at playing digital games. Similar results were obtained with pattern discrimination, in which a pattern representing the sound of one word was presented to the skin, followed by that of a second word. Participants answered whether the word was the same or different. With minimal difference pairs (distinguished by only one phoneme, such as "house" and "mouse"), the best performance was 83% (average of 62%), while with non-minimal pairs (such as "house" and "zip") the best performance was 100% (average of 70%). Collectively, these results demonstrate that participants are capable of using the channel of the skin to interpret auditory stimuli, opening the way for low-cost, wearable sensory substitution for the deaf and hard of hearing communities.

Motor-sensory recalibration leads to an illusory reversal of action and sensation.

To judge causality, organisms must determine the temporal order of their actions and sensations. However, this judgment may be confounded by changing delays in sensory pathways, suggesting the need for dynamic temporal recalibration. To test for such a mechanism, we artificially injected a fixed delay between participants' actions (keypresses) and subsequent sensations (flashes). After participants adapted to this delay, flashes at unexpectedly short delays after the keypress were often perceived as occurring before the keypress, demonstrating a recalibration of motor-sensory temporal order judgments. When participants experienced illusory reversals, fMRI BOLD signals increased in anterior cingulate cortex/medial frontal cortex (ACC/MFC), a brain region previously implicated in conflict monitoring. This illusion-specific activation suggests that the brain maintains not only a recalibrated representation of timing, but also a less-plastic representation against which to compare it.

Human time perception and its illusions.

Why does a clock sometimes appear stopped? Is it possible to perceive the world in slow motion during a car accident? Can action and effect be reversed? Time perception is surprisingly prone to measurable distortions and illusions. The past few years have introduced remarkable progress in identifying and quantifying temporal illusions of duration, temporal order, and simultaneity. For example, perceived durations can be distorted by saccades, by an oddball in a sequence, or by stimulus complexity or magnitude. Temporal order judgments of actions and sensations can be reversed by the exposure to delayed motor consequences, and simultaneity judgments can be manipulated by repeated exposure to nonsimultaneous stimuli. The confederacy of recently discovered illusions points to the underlying neural mechanisms of time perception.

Why color synesthesia involves more than color.

Synesthesia is a perceptual phenomenon in which stimuli can trigger experiences in non-stimulated sensory dimensions. The literature has focused on forms of synesthesia in which stimuli (e.g. music, touch or numbers) trigger experiences of color. Generally missing, however, is the observation that synesthetic colors are often accompanied by the experience of other surface properties such as texture (e.g. a visual experience of linen, metal, marble, velvet, etc). Current frameworks for synesthesia focus only upon the involvement of brain regions such as the V4 color complex. Here, we propose an expanded framework that includes brain regions involved in the encoding of material properties - specifically, larger regions of the medial ventral stream. The overlap of visual texture and color processing within ventral regions might explain why many experiences of synesthesia extend beyond color to other material properties.

Perceived luminance depends on temporal context.

Brightness--the perception of an object's luminance--arises from complex and poorly understood interactions at several levels of processing. It is well known that the brightness of an object depends on its spatial context, which can include perceptual organization, scene interpretation, three-dimensional interpretation, shadows, and other high-level percepts. Here we present a new class of illusion in which temporal relations with spatially neighbouring objects can modulate a target object's brightness. When compared with a nearby patch of constant luminance, a brief flash appears brighter with increasing onset asynchrony. Simultaneous contrast, retinal effects, masking, apparent motion and attentional effects cannot account for this illusory enhancement of brightness. This temporal context effect indicates that two parallel streams--one adapting and one non-adapting--encode brightness in the visual cortex.