Distribution of multiunit pitch responses recorded intracranially from human auditory cortex.

The perception of pitch is a fundamental percept, which is mediated by the auditory system, requiring the abstraction of stimulus properties related to the spectro-temporal structure of sound. Despite its importance, there is still debate as to the precise areas responsible for its encoding, which may be due to species differences or differences in the recording measures and choices of stimuli used in previous studies. Moreover, it was unknown whether the human brain contains pitch neurons and how distributed such neurons might be. Here, we present the first study to measure multiunit neural activity in response to pitch stimuli in the auditory cortex of intracranially implanted humans. The stimulus sets were regular-interval noise with a pitch strength that is related to the temporal regularity and a pitch value determined by the repetition rate and harmonic complexes. Specifically, we demonstrate reliable responses to these different pitch-inducing paradigms that are distributed throughout Heschl's gyrus, rather than being localized to a particular region, and this finding was evident regardless of the stimulus presented. These data provide a bridge across animal and human studies and aid our understanding of the processing of a critical percept associated with acoustic stimuli.

A specific relationship between musical sophistication and auditory working memory.

Previous studies have found conflicting results between individual measures related to music and fundamental aspects of auditory perception and cognition. The results have been difficult to compare because of different musical measures being used and lack of uniformity in the auditory perceptual and cognitive measures. In this study we used a general construct of musicianship, musical sophistication, that can be applied to populations with widely different backgrounds. We investigated the relationship between musical sophistication and measures of perception and working memory for sound by using a task suitable to measure both. We related scores from the Goldsmiths Musical Sophistication Index to performance on tests of perception and working memory for two acoustic features-frequency and amplitude modulation. The data show that musical sophistication scores are best related to working memory for frequency in an analysis that accounts for age and non-verbal intelligence. Musical sophistication was not significantly associated with working memory for amplitude modulation rate or with the perception of either acoustic feature. The work supports a specific association between musical sophistication and working memory for sound frequency.

The Representation of Time Windows in Primate Auditory Cortex.

Whether human and nonhuman primates process the temporal dimension of sound similarly remains an open question. We examined the brain basis for the processing of acoustic time windows in rhesus macaques using stimuli simulating the spectrotemporal complexity of vocalizations. We conducted functional magnetic resonance imaging in awake macaques to identify the functional anatomy of response patterns to different time windows. We then contrasted it against the responses to identical stimuli used previously in humans. Despite a similar overall pattern, ranging from the processing of shorter time windows in core areas to longer time windows in lateral belt and parabelt areas, monkeys exhibited lower sensitivity to longer time windows than humans. This difference in neuronal sensitivity might be explained by a specialization of the human brain for processing longer time windows in speech.

Dynamics underlying auditory-object-boundary detection in primary auditory cortex.

Auditory object analysis requires the fundamental perceptual process of detecting boundaries between auditory objects. However, the dynamics underlying the identification of discontinuities at object boundaries are not well understood. Here, we employed a synthetic stimulus composed of frequency-modulated ramps known as 'acoustic textures', where boundaries were created by changing the underlying spectrotemporal statistics. We collected magnetoencephalographic (MEG) data from human volunteers and observed a slow (<1 Hz) post-boundary drift in the neuromagnetic signal. The response evoking this drift signal was source localised close to Heschl's gyrus (HG) bilaterally, which is in agreement with a previous functional magnetic resonance imaging (fMRI) study that found HG to be involved in the detection of similar auditory object boundaries. Time-frequency analysis demonstrated suppression in alpha and beta bands that occurred after the drift signal.

Neuronal figure-ground responses in primate primary auditory cortex.

Figure-ground segregation, the brain's ability to group related features into stable perceptual entities, is crucial for auditory perception in noisy environments. The neuronal mechanisms for this process are poorly understood in the auditory system. Here, we report figure-ground modulation of multi-unit activity (MUA) in the primary and non-primary auditory cortex of rhesus macaques. Across both regions, MUA increases upon presentation of auditory figures, which consist of coherent chord sequences. We show increased activity even in the absence of any perceptual decision, suggesting that neural mechanisms for perceptual grouping are, to some extent, independent of behavioral demands. Furthermore, we demonstrate differences in figure encoding between more anterior and more posterior regions; perceptual saliency is represented in anterior cortical fields only. Our results suggest an encoding of auditory figures from the earliest cortical stages by a rate code.

The Motor Basis for Misophonia.

Misophonia is a common disorder characterized by the experience of strong negative emotions of anger and anxiety in response to certain everyday sounds, such as those generated by other people eating, drinking, and breathing. The commonplace nature of these "trigger" sounds makes misophonia a devastating disorder for sufferers and their families. How such innocuous sounds trigger this response is unknown. Since most trigger sounds are generated by orofacial movements (e.g., chewing) in others, we hypothesized that the mirror neuron system related to orofacial movements could underlie misophonia. We analyzed resting state fMRI (rs-fMRI) connectivity (N = 33, 16 females) and sound-evoked fMRI responses (N = 42, 29 females) in misophonia sufferers and controls. We demonstrate that, compared with controls, the misophonia group show no difference in auditory cortex responses to trigger sounds, but do show: (1) stronger rs-fMRI connectivity between both auditory and visual cortex and the ventral premotor cortex responsible for orofacial movements; (2) stronger functional connectivity between the auditory cortex and orofacial motor area during sound perception in general; and (3) stronger activation of the orofacial motor area, specifically, in response to trigger sounds. Our results support a model of misophonia based on "hyper-mirroring" of the orofacial actions of others with sounds being the "medium" via which action of others is excessively mirrored. Misophonia is therefore not an abreaction to sounds, per se, but a manifestation of activity in parts of the motor system involved in producing those sounds. This new framework to understand misophonia can explain behavioral and emotional responses and has important consequences for devising effective therapies.SIGNIFICANCE STATEMENT Conventionally, misophonia, literally "hatred of sounds" has been considered as a disorder of sound emotion processing, in which "simple" eating and chewing sounds produced by others cause negative emotional responses. Our data provide an alternative but complementary perspective on misophonia that emphasizes the action of the trigger-person rather than the sounds which are a byproduct of that action. Sounds, in this new perspective, are only a "medium" via which action of the triggering-person is mirrored onto the listener. This change in perspective has important consequences for devising therapies and treatment methods for misophonia. It suggests that, instead of focusing on sounds, which many existing therapies do, effective therapies should target the brain representation of movement.

Oscillatory correlates of auditory working memory examined with human electrocorticography.

This work examines how sounds are held in auditory working memory (AWM) in humans by examining oscillatory local field potentials (LFPs) in candidate brain regions. Previous fMRI studies by our group demonstrated blood oxygenation level-dependent (BOLD) response increases during maintenance in auditory cortex, inferior frontal cortex and the hippocampus using a paradigm with a delay period greater than 10s. The relationship between such BOLD changes and ensemble activity in different frequency bands is complex, and the long delay period raised the possibility that long-term memory mechanisms were engaged. Here we assessed LFPs in different frequency bands in six subjects with recordings from all candidate brain regions using a paradigm with a short delay period of 3 s. Sustained delay activity was demonstrated in all areas, with different patterns in the different areas. Enhancement in low frequency (delta) power and suppression across higher frequencies (beta/gamma) were demonstrated in primary auditory cortex in medial Heschl's gyrus (HG) whilst non-primary cortex showed patterns of enhancement and suppression that altered at different levels of the auditory hierarchy from lateral HG to superior- and middle-temporal gyrus. Inferior frontal cortex showed increasing suppression with increasing frequency. The hippocampus and parahippocampal gyrus showed low frequency increases and high frequency decreases in oscillatory activity. This work demonstrates sustained activity patterns during AWM maintenance, with prominent low-frequency increases in medial temporal lobe regions.

Multivoxel codes for representing and integrating acoustic features in human cortex.

Using fMRI and multivariate pattern analysis, we determined whether spectral and temporal acoustic features are represented by independent or integrated multivoxel codes in human cortex. Listeners heard band-pass noise varying in frequency (spectral) and amplitude-modulation (AM) rate (temporal) features. In the superior temporal plane, changes in multivoxel activity due to frequency were largely invariant with respect to AM rate (and vice versa), consistent with an independent representation. In contrast, in posterior parietal cortex, multivoxel representation was exclusively integrated and tuned to specific conjunctions of frequency and AM features (albeit weakly). Direct between-region comparisons show that whereas independent coding of frequency weakened with increasing levels of the hierarchy, such a progression for AM and integrated coding was less fine-grained and only evident in the higher hierarchical levels from non-core to parietal cortex (with AM coding weakening and integrated coding strengthening). Our findings support the notion that primary auditory cortex can represent spectral and temporal acoustic features in an independent fashion and suggest a role for parietal cortex in feature integration and the structuring of sensory input.

Exposing Pathological Sensory Predictions in Tinnitus Using Auditory Intensity Deviant Evoked Responses.

We tested the popular, unproven theory that tinnitus is caused by resetting of auditory predictions toward a persistent low-intensity sound. Electroencephalographic mismatch negativity responses, which quantify the violation of sensory predictions, to unattended tinnitus-like sounds were greater in response to upward than downward intensity deviants in 26 unselected chronic tinnitus subjects with normal to severely impaired hearing, and in 15 acute tinnitus subjects, but not in 26 hearing and age-matched controls (p < 0.001, receiver operator characteristic, area under the curve, 0.77), or in 20 healthy and hearing-impaired controls presented with simulated tinnitus. The findings support a prediction resetting model of tinnitus generation, and may form the basis of a convenient tinnitus biomarker, which we name Intensity Mismatch Asymmetry, which is usable across species, is quick and tolerable, and requires no training.SIGNIFICANCE STATEMENT In current models, perception is based around the generation of internal predictions of the environment, which are tested and updated using evidence from the senses. Here, we test the theory that auditory phantom perception (tinnitus) occurs when a default auditory prediction is formed to explain spontaneous activity in the subcortical pathway, rather than ignoring it as noise. We find that chronic tinnitus patients show an abnormal pattern of evoked responses to unexpectedly loud and quiet sounds that both supports this hypothesis and provides fairly accurate classification of tinnitus status at the individual subject level. This approach to objectively demonstrating the predictions underlying pathological perceptual states may also have a much wider utility, for instance, in chronic pain.

Niemann-Pick type C: contemporary diagnosis and treatment of a classical disorder.

Niemann-Pick type C is an uncommon neurodegenerative lysosomal storage disorder that can cause a progressive neuropsychiatric syndrome associated with supranuclear vertical gaze palsy and a movement disorder. There have been recent developments in testing that make diagnosis easier and new therapies that aim to stabilise the disease process. A new biochemical test to measure serum cholesterol metabolites supersedes the skin biopsy and is practical and robust. It is treatable with miglustat, a drug that inhibits glycosphingolipid synthesis. We describe a patient, aged 22 years, with juvenile-onset Niemann-Pick type C who presented with seizures and a label of 'cerebral palsy'. We describe the approach to this syndrome in general, and highlight the classical features and red flags that should alert a neurologist to this treatable condition.

Auditory figure-ground analysis in rostral belt and parabelt of the macaque monkey.

Segregating the key features of the natural world within crowded visual or sound scenes is a critical aspect of everyday perception. The neurobiological bases for auditory figure-ground segregation are poorly understood. We demonstrate that macaques perceive an acoustic figure-ground stimulus with comparable performance to humans using a neural system that involves high-level auditory cortex, localised to the rostral belt and parabelt.

Artificial grammar learning in vascular and progressive non-fluent aphasias.

Patients with non-fluent aphasias display impairments of expressive and receptive grammar. This has been attributed to deficits in processing configurational and hierarchical sequencing relationships. This hypothesis had not been formally tested. It was also controversial whether impairments are specific to language, or reflect domain general deficits in processing structured auditory sequences. Here we used an artificial grammar learning paradigm to compare the abilities of controls to participants with agrammatic aphasia of two different aetiologies: stroke and frontotemporal dementia. Ten patients with non-fluent variant primary progressive aphasia (nfvPPA), 12 with non-fluent aphasia due to stroke, and 11 controls implicitly learned a novel mixed-complexity artificial grammar designed to assess processing of increasingly complex sequencing relationships. We compared response profiles for otherwise identical sequences of speech tokens (nonsense words) and tone sweeps. In all three groups the ability to detect grammatical violations varied with sequence complexity, with performance improving over time and being better for adjacent than non-adjacent relationships. Patients performed less well than controls overall, and this was related more strongly to aphasia severity than to aetiology. All groups improved with practice and performed well at a control task of detecting oddball nonwords. Crucially, group differences did not interact with sequence complexity, demonstrating that aphasic patients were not disproportionately impaired on complex structures. Hierarchical cluster analysis revealed that response patterns were very similar across all three groups, but very different between the nonsense word and tone tasks, despite identical artificial grammar structures. Overall, we demonstrate that agrammatic aphasics of two different aetiologies are not disproportionately impaired on complex sequencing relationships, and that the learning of phonological and non-linguistic sequences occurs independently. The similarity of profiles of discriminatory abilities and rule learning across groups suggests that insights from previous studies of implicit sequence learning in vascular aphasia are likely to prove applicable in nfvPPA.

Individually customisable non-invasive head immobilisation system for non-human primates with an option for voluntary engagement.

BACKGROUND: Head immobilisation is often necessary for neuroscientific procedures. A number of Non-invasive Head Immobilisation Systems (NHIS) for monkeys are available, but the need remains for a feasible integrated system combining a broad range of essential features. NEW METHOD: We developed an individualised macaque NHIS addressing several animal welfare and scientific needs. The system comprises a customised-to-fit facemask that can be used separately or combined with a back piece to form a full-head helmet. The system permits presentation of visual and auditory stimuli during immobilisation and provides mouth access for reward. RESULTS: The facemask was incorporated into an automated voluntary training system, allowing the animals to engage with it for increasing periods leading to full head immobilisation. We evaluated the system during performance on several auditory or visual behavioural tasks with testing sessions lasting 1.5-2h, used thermal imaging to monitor for and prevent pressure points, and measured head movement using MRI. COMPARISON WITH EXISTING METHODS: A comprehensive evaluation of the system is provided in relation to several scientific and animal welfare requirements. Behavioural results were often comparable to those obtained with surgical implants. Cost-benefit analyses were conducted comparing the system with surgical options, highlighting the benefits of implementing the non-invasive option. CONCLUSIONS: The system has a number of potential applications and could be an important tool in neuroscientific research, when direct access to the brain for neuronal recordings is not required, offering the opportunity to conduct non-invasive experiments while improving animal welfare and reducing reliance on surgically implanted head posts.

Large-Scale Analysis of Auditory Segregation Behavior Crowdsourced via a Smartphone App.

The human auditory system is adept at detecting sound sources of interest from a complex mixture of several other simultaneous sounds. The ability to selectively attend to the speech of one speaker whilst ignoring other speakers and background noise is of vital biological significance-the capacity to make sense of complex 'auditory scenes' is significantly impaired in aging populations as well as those with hearing loss. We investigated this problem by designing a synthetic signal, termed the 'stochastic figure-ground' stimulus that captures essential aspects of complex sounds in the natural environment. Previously, we showed that under controlled laboratory conditions, young listeners sampled from the university subject pool (n = 10) performed very well in detecting targets embedded in the stochastic figure-ground signal. Here, we presented a modified version of this cocktail party paradigm as a 'game' featured in a smartphone app (The Great Brain Experiment) and obtained data from a large population with diverse demographical patterns (n = 5148). Despite differences in paradigms and experimental settings, the observed target-detection performance by users of the app was robust and consistent with our previous results from the psychophysical study. Our results highlight the potential use of smartphone apps in capturing robust large-scale auditory behavioral data from normal healthy volunteers, which can also be extended to study auditory deficits in clinical populations with hearing impairments and central auditory disorders.

A Brain System for Auditory Working Memory.

The brain basis for auditory working memory, the process of actively maintaining sounds in memory over short periods of time, is controversial. Using functional magnetic resonance imaging in human participants, we demonstrate that the maintenance of single tones in memory is associated with activation in auditory cortex. In addition, sustained activation was observed in hippocampus and inferior frontal gyrus. Multivoxel pattern analysis showed that patterns of activity in auditory cortex and left inferior frontal gyrus distinguished the tone that was maintained in memory. Functional connectivity during maintenance was demonstrated between auditory cortex and both the hippocampus and inferior frontal cortex. The data support a system for auditory working memory based on the maintenance of sound-specific representations in auditory cortex by projections from higher-order areas, including the hippocampus and frontal cortex. SIGNIFICANCE STATEMENT: In this work, we demonstrate a system for maintaining sound in working memory based on activity in auditory cortex, hippocampus, and frontal cortex, and functional connectivity among them. Specifically, our work makes three advances from the previous work. First, we robustly demonstrate hippocampal involvement in all phases of auditory working memory (encoding, maintenance, and retrieval): the role of hippocampus in working memory is controversial. Second, using a pattern classification technique, we show that activity in the auditory cortex and inferior frontal gyrus is specific to the maintained tones in working memory. Third, we show long-range connectivity of auditory cortex to hippocampus and frontal cortex, which may be responsible for keeping such representations active during working memory maintenance.

Inattentional Deafness: Visual Load Leads to Time-Specific Suppression of Auditory Evoked Responses.

Due to capacity limits on perception, conditions of high perceptual load lead to reduced processing of unattended stimuli (Lavie et al., 2014). Accumulating work demonstrates the effects of visual perceptual load on visual cortex responses, but the effects on auditory processing remain poorly understood. Here we establish the neural mechanisms underlying "inattentional deafness"--the failure to perceive auditory stimuli under high visual perceptual load. Participants performed a visual search task of low (target dissimilar to nontarget items) or high (target similar to nontarget items) load. On a random subset (50%) of trials, irrelevant tones were presented concurrently with the visual stimuli. Brain activity was recorded with magnetoencephalography, and time-locked responses to the visual search array and to the incidental presence of unattended tones were assessed. High, compared to low, perceptual load led to increased early visual evoked responses (within 100 ms from onset). This was accompanied by reduced early (∼ 100 ms from tone onset) auditory evoked activity in superior temporal sulcus and posterior middle temporal gyrus. A later suppression of the P3 "awareness" response to the tones was also observed under high load. A behavioral experiment revealed reduced tone detection sensitivity under high visual load, indicating that the reduction in neural responses was indeed associated with reduced awareness of the sounds. These findings support a neural account of shared audiovisual resources, which, when depleted under load, leads to failures of sensory perception and awareness. SIGNIFICANCE STATEMENT: The present work clarifies the neural underpinning of inattentional deafness under high visual load. The findings of near-simultaneous load effects on both visual and auditory evoked responses suggest shared audiovisual processing capacity. Temporary depletion of shared capacity in perceptually demanding visual tasks leads to a momentary reduction in sensory processing of auditory stimuli, resulting in inattentional deafness. The dynamic "push-pull" pattern of load effects on visual and auditory processing furthers our understanding of both the neural mechanisms of attention and of cross-modal effects across visual and auditory processing. These results also offer an explanation for many previous failures to find cross-modal effects in experiments where the visual load effects may not have coincided directly with auditory sensory processing.

Sensitivity to the temporal structure of rapid sound sequences - An MEG study.

To probe sensitivity to the time structure of ongoing sound sequences, we measured MEG responses, in human listeners, to the offset of long tone-pip sequences containing various forms of temporal regularity. If listeners learn sequence temporal properties and form expectancies about the arrival time of an upcoming tone, sequence offset should be detectable as soon as an expected tone fails to arrive. Therefore, latencies of offset responses are indicative of the extent to which the temporal pattern has been acquired. In Exp1, sequences were isochronous with tone inter-onset-interval (IOI) set to 75, 125 or 225ms. Exp2 comprised of non-isochronous, temporally regular sequences, comprised of the IOIs above. Exp3 used the same sequences as Exp2 but listeners were required to monitor them for occasional frequency deviants. Analysis of the latency of offset responses revealed that the temporal structure of (even rather simple) regular sequences is not learnt precisely when the sequences are ignored. Pattern coding, supported by a network of temporal, parietal and frontal sources, improved considerably when the signals were made behaviourally pertinent. Thus, contrary to what might be expected in the context of an 'early warning system' framework, learning of temporal structure is not automatic, but affected by the signal's behavioural relevance.

Direct physiologic evidence of a heteromodal convergence region for proper naming in human left anterior temporal lobe.

Retrieving the names of friends, loved ones, and famous people is a fundamental human ability. This ability depends on the left anterior temporal lobe (ATL), where lesions can be associated with impaired naming of people regardless of modality (e.g., picture or voice). This finding has led to the idea that the left ATL is a modality-independent convergence region for proper naming. Hypotheses for how proper-name dispositions are organized within the left ATL include both a single modality-independent (heteromodal) convergence region and spatially discrete modality-dependent (unimodal) regions. Here we show direct electrophysiologic evidence that the left ATL is heteromodal for proper-name retrieval. Using intracranial recordings placed directly on the surface of the left ATL in human subjects, we demonstrate nearly identical responses to picture and voice stimuli of famous U.S. politicians during a naming task. Our results demonstrate convergent and robust large-scale neurophysiologic responses to picture and voice naming in the human left ATL. This finding supports the idea of heteromodal (i.e., transmodal) dispositions for proper naming in the left ATL.

Representations of specific acoustic patterns in the auditory cortex and hippocampus.

Previous behavioural studies have shown that repeated presentation of a randomly chosen acoustic pattern leads to the unsupervised learning of some of its specific acoustic features. The objective of our study was to determine the neural substrate for the representation of freshly learnt acoustic patterns. Subjects first performed a behavioural task that resulted in the incidental learning of three different noise-like acoustic patterns. During subsequent high-resolution functional magnetic resonance imaging scanning, subjects were then exposed again to these three learnt patterns and to others that had not been learned. Multi-voxel pattern analysis was used to test if the learnt acoustic patterns could be 'decoded' from the patterns of activity in the auditory cortex and medial temporal lobe. We found that activity in planum temporale and the hippocampus reliably distinguished between the learnt acoustic patterns. Our results demonstrate that these structures are involved in the neural representation of specific acoustic patterns after they have been learnt.