Talking with hands and feet: Selective somatosensory attention and fMRI enable robust and convenient brain-based communication.

In brain-based communication, voluntarily modulated brain signals (instead of motor output) are utilized to interact with the outside world. The possibility to circumvent the motor system constitutes an important alternative option for severely paralyzed. Most communication brain-computer interface (BCI) paradigms require intact visual capabilities and impose a high cognitive load, but for some patients, these requirements are not given. In these situations, a better-suited, less cognitively demanding information-encoding approach may exploit auditorily-cued selective somatosensory attention to vibrotactile stimulation. Here, we propose, validate and optimize a novel communication-BCI paradigm using differential fMRI activation patterns evoked by selective somatosensory attention to tactile stimulation of the right hand or left foot. Using cytoarchitectonic probability maps and multi-voxel pattern analysis (MVPA), we show that the locus of selective somatosensory attention can be decoded from fMRI-signal patterns in (especially primary) somatosensory cortex with high accuracy and reliability, with the highest classification accuracy (85.93%) achieved when using Brodmann area 2 (SI-BA2) at a probability level of 0.2. Based on this outcome, we developed and validated a novel somatosensory attention-based yes/no communication procedure and demonstrated its high effectiveness even when using only a limited amount of (MVPA) training data. For the BCI user, the paradigm is straightforward, eye-independent, and requires only limited cognitive functioning. In addition, it is BCI-operator friendly given its objective and expertise-independent procedure. For these reasons, our novel communication paradigm has high potential for clinical applications.

Magnetic resonance imaging at 9.4 T: the Maastricht journey.

The 9.4 T scanner in Maastricht is a whole-body magnet with head gradients and parallel RF transmit capability. At the time of the design, it was conceptualized to be one of the best fMRI scanners in the world, but it has also been used for anatomical and diffusion imaging. 9.4 T offers increases in sensitivity and contrast, but the technical ultra-high field (UHF) challenges, such as field inhomogeneities and constraints set by RF power deposition, are exacerbated compared to 7 T. This article reviews some of the 9.4 T work done in Maastricht. Functional imaging experiments included blood oxygenation level-dependent (BOLD) and blood-volume weighted (VASO) fMRI using different readouts. BOLD benefits from shorter T2* at 9.4 T while VASO from longer T1. We show examples of both ex vivo and in vivo anatomical imaging. For many applications, pTx and optimized coils are essential to harness the full potential of 9.4 T. Our experience shows that, while considerable effort was required compared to our 7 T scanner, we could obtain high-quality anatomical and functional data, which illustrates the potential of MR acquisitions at even higher field strengths. The practical challenges of working with a relatively unique system are also discussed.

Predictors of real-time fMRI neurofeedback performance and improvement - A machine learning mega-analysis.

Real-time fMRI neurofeedback is an increasingly popular neuroimaging technique that allows an individual to gain control over his/her own brain signals, which can lead to improvements in behavior in healthy participants as well as to improvements of clinical symptoms in patient populations. However, a considerably large ratio of participants undergoing neurofeedback training do not learn to control their own brain signals and, consequently, do not benefit from neurofeedback interventions, which limits clinical efficacy of neurofeedback interventions. As neurofeedback success varies between studies and participants, it is important to identify factors that might influence neurofeedback success. Here, for the first time, we employed a big data machine learning approach to investigate the influence of 20 different design-specific (e.g. activity vs. connectivity feedback), region of interest-specific (e.g. cortical vs. subcortical) and subject-specific factors (e.g. age) on neurofeedback performance and improvement in 608 participants from 28 independent experiments. With a classification accuracy of 60% (considerably different from chance level), we identified two factors that significantly influenced neurofeedback performance: Both the inclusion of a pre-training no-feedback run before neurofeedback training and neurofeedback training of patients as compared to healthy participants were associated with better neurofeedback performance. The positive effect of pre-training no-feedback runs on neurofeedback performance might be due to the familiarization of participants with the neurofeedback setup and the mental imagery task before neurofeedback training runs. Better performance of patients as compared to healthy participants might be driven by higher motivation of patients, higher ranges for the regulation of dysfunctional brain signals, or a more extensive piloting of clinical experimental paradigms. Due to the large heterogeneity of our dataset, these findings likely generalize across neurofeedback studies, thus providing guidance for designing more efficient neurofeedback studies specifically for improving clinical neurofeedback-based interventions. To facilitate the development of data-driven recommendations for specific design details and subpopulations the field would benefit from stronger engagement in open science research practices and data sharing.

Selective auditory attention within naturalistic scenes modulates reactivity to speech sounds.

Rapid recognition and categorization of sounds are essential for humans and animals alike, both for understanding and reacting to our surroundings and for daily communication and social interaction. For humans, perception of speech sounds is of crucial importance. In real life, this task is complicated by the presence of a multitude of meaningful non-speech sounds. The present behavioural, magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) study was set out to address how attention to speech versus attention to natural non-speech sounds within complex auditory scenes influences cortical processing. The stimuli were superimpositions of spoken words and environmental sounds, with parametric variation of the speech-to-environmental sound intensity ratio. The participants' task was to detect a repetition in either the speech or the environmental sound. We found that specifically when participants attended to speech within the superimposed stimuli, higher speech-to-environmental sound ratios resulted in shorter sustained MEG responses and stronger BOLD fMRI signals especially in the left supratemporal auditory cortex and in improved behavioural performance. No such effects of speech-to-environmental sound ratio were observed when participants attended to the environmental sound part within the exact same stimuli. These findings suggest stronger saliency of speech compared with other meaningful sounds during processing of natural auditory scenes, likely linked to speech-specific top-down and bottom-up mechanisms activated during speech perception that are needed for tracking speech in real-life-like auditory environments.

Consensus on the reporting and experimental design of clinical and cognitive-behavioural neurofeedback studies (CRED-nf checklist).

Neurofeedback has begun to attract the attention and scrutiny of the scientific and medical mainstream. Here, neurofeedback researchers present a consensus-derived checklist that aims to improve the reporting and experimental design standards in the field.

Can we predict real-time fMRI neurofeedback learning success from pretraining brain activity?

Neurofeedback training has been shown to influence behavior in healthy participants as well as to alleviate clinical symptoms in neurological, psychosomatic, and psychiatric patient populations. However, many real-time fMRI neurofeedback studies report large inter-individual differences in learning success. The factors that cause this vast variability between participants remain unknown and their identification could enhance treatment success. Thus, here we employed a meta-analytic approach including data from 24 different neurofeedback studies with a total of 401 participants, including 140 patients, to determine whether levels of activity in target brain regions during pretraining functional localizer or no-feedback runs (i.e., self-regulation in the absence of neurofeedback) could predict neurofeedback learning success. We observed a slightly positive correlation between pretraining activity levels during a functional localizer run and neurofeedback learning success, but we were not able to identify common brain-based success predictors across our diverse cohort of studies. Therefore, advances need to be made in finding robust models and measures of general neurofeedback learning, and in increasing the current study database to allow for investigating further factors that might influence neurofeedback learning.

Control freaks: Towards optimal selection of control conditions for fMRI neurofeedback studies.

fMRI Neurofeedback research employs many different control conditions. Currently, there is no consensus as to which control condition is best, and the answer depends on what aspects of the neurofeedback-training design one is trying to control for. These aspects can range from determining whether participants can learn to control brain activity via neurofeedback to determining whether there are clinically significant effects of the neurofeedback intervention. Lack of consensus over criteria for control conditions has hampered the design and interpretation of studies employing neurofeedback protocols. This paper presents an overview of the most commonly employed control conditions currently used in neurofeedback studies and discusses their advantages and disadvantages. Control conditions covered include no control, treatment-as-usual, bidirectional-regulation control, feedback of an alternative brain signal, sham feedback, and mental-rehearsal control. We conclude that the selection of the control condition(s) should be determined by the specific research goal of the study and best procedures that effectively control for relevant confounding factors.

The potential of MR-Encephalography for BCI/Neurofeedback applications with high temporal resolution.

Real-time functional magnetic resonance imaging (rt-fMRI) enables the update of various brain-activity measures during an ongoing experiment as soon as a new brain volume is acquired. However, the recorded Blood-oxygen-level dependent (BOLD) signal also contains physiological artifacts such as breathing and heartbeat, which potentially cause misleading false positive effects especially problematic in brain-computer interface (BCI) and neurofeedback (NF) setups. The low temporal resolution of echo planar imaging (EPI) sequences (which is in the range of seconds) prevents a proper separation of these artifacts from the BOLD signal. MR-Encephalography (MREG) has been shown to provide the high temporal resolution required to unalias and correct for physiological fluctuations and leads to increased specificity and sensitivity for mapping task-based activation and functional connectivity as well as for detecting dynamic changes in connectivity over time. By comparing a simultaneous multislice echo planar imaging (SMS-EPI) sequence and an MREG sequence using the same nominal spatial resolution in an offline analysis for three different experimental fMRI paradigms (perception of house and face stimuli, motor imagery, Stroop task), the potential of this novel technique for future BCI and NF applications was investigated. First, adapted general linear model pre-whitening which accounts for the high temporal resolution in MREG was implemented to calculate proper statistical results and be able to compare these with the SMS-EPI sequence. Furthermore, the respiration- and cardiac pulsation-related signals were successfully separated from the MREG signal using independent component analysis which were then included as regressors for a GLM analysis. Only the MREG sequence allowed to clearly separate cardiac pulsation and respiration components from the signal time course. It could be shown that these components highly correlate with the recorded respiration and cardiac pulsation signals using a respiratory belt and fingertip pulse plethysmograph. Temporal signal-to-noise ratios of SMS-EPI and MREG were comparable. Functional connectivity analysis using partial correlation showed a reduced standard error in MREG compared to SMS-EPI. Also, direct time course comparisons by down-sampling the MREG signal to the SMS-EPI temporal resolution showed lower variance in MREG. In general, we show that the higher temporal resolution is beneficial for fMRI time course modeling and this aspect can be exploited in offline application but also, is especially attractive, for real-time BCI and NF applications.

Frequency-specific attentional modulation in human primary auditory cortex and midbrain.

Paying selective attention to an audio frequency selectively enhances activity within primary auditory cortex (PAC) at the tonotopic site (frequency channel) representing that frequency. Animal PAC neurons achieve this 'frequency-specific attentional spotlight' by adapting their frequency tuning, yet comparable evidence in humans is scarce. Moreover, whether the spotlight operates in human midbrain is unknown. To address these issues, we studied the spectral tuning of frequency channels in human PAC and inferior colliculus (IC), using 7-T functional magnetic resonance imaging (FMRI) and frequency mapping, while participants focused on different frequency-specific sounds. We found that shifts in frequency-specific attention alter the response gain, but not tuning profile, of PAC frequency channels. The gain modulation was strongest in low-frequency channels and varied near-monotonically across the tonotopic axis, giving rise to the attentional spotlight. We observed less prominent, non-tonotopic spatial patterns of attentional modulation in IC. These results indicate that the frequency-specific attentional spotlight in human PAC as measured with FMRI arises primarily from tonotopic gain modulation, rather than adapted frequency tuning. Moreover, frequency-specific attentional modulation of afferent sound processing in human IC seems to be considerably weaker, suggesting that the spotlight diminishes toward this lower-order processing stage. Our study sheds light on how the human auditory pathway adapts to the different demands of selective hearing.

Frequency-Selective Attention in Auditory Scenes Recruits Frequency Representations Throughout Human Superior Temporal Cortex.

A sound of interest may be tracked amid other salient sounds by focusing attention on its characteristic features including its frequency. Functional magnetic resonance imaging findings have indicated that frequency representations in human primary auditory cortex (AC) contribute to this feat. However, attentional modulations were examined at relatively low spatial and spectral resolutions, and frequency-selective contributions outside the primary AC could not be established. To address these issues, we compared blood oxygenation level-dependent (BOLD) responses in the superior temporal cortex of human listeners while they identified single frequencies versus listened selectively for various frequencies within a multifrequency scene. Using best-frequency mapping, we observed that the detailed spatial layout of attention-induced BOLD response enhancements in primary AC follows the tonotopy of stimulus-driven frequency representations-analogous to the "spotlight" of attention enhancing visuospatial representations in retinotopic visual cortex. Moreover, using an algorithm trained to discriminate stimulus-driven frequency representations, we could successfully decode the focus of frequency-selective attention from listeners' BOLD response patterns in nonprimary AC. Our results indicate that the human brain facilitates selective listening to a frequency of interest in a scene by reinforcing the fine-grained activity pattern throughout the entire superior temporal cortex that would be evoked if that frequency was present alone.