Removal of physiological artifacts from simultaneous EEG and fMRI recordings.

OBJECTIVE: Simultaneous recording of the electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) allows a combination of eletrophysiological and haemodynamic information to be used to form a more complete picture of cerebral dynamics. However, EEG recorded within the MRI scanner is contaminated by both imaging artifacts and physiological artifacts. The majority of the techniques used to pre-process such EEG focus on removal of the imaging and balistocardiogram artifacts, with some success, but don't remove all other physiological artifacts. METHODS: We propose a new offline EEG artifact removal method based upon a combination of independent component analysis and fMRI-based head movement estimation to aid the removal of physiological artifacts from EEG recorded during EEG-fMRI recordings. Our method makes novel use of head movement trajectories estimated from the fMRI recording in order to assist with identifying physiological artifacts in the EEG and is designed to be used after removal of the fMRI imaging artifact from the EEG. RESULTS: We evaluate our method on EEG recorded during a joint EEG-fMRI session from healthy adult participants. Our method significantly reduces the influence of all types of physiological artifacts on the EEG. We also compare our method with a state-of-the-art physiological artifact removal method and demonstrate superior performance removing physiological artifacts. CONCLUSIONS: Our proposed method is able to remove significantly more physiological artifact components from the EEG, recorded during a joint EEG-fMRI session, than other state-of-the-art methods. SIGNIFICANCE: Our proposed method represents a marked improvement over current processing pipelines for removing physiological noise from EEG recorded during a joint EEG-fMRI session.

Decoding of semantic categories of imagined concepts of animals and tools in fNIRS.

Objective.Semantic decoding refers to the identification of semantic concepts from recordings of an individual's brain activity. It has been previously reported in functional magnetic resonance imaging and electroencephalography. We investigate whether semantic decoding is possible with functional near-infrared spectroscopy (fNIRS). Specifically, we attempt to differentiate between the semantic categories of animals and tools. We also identify suitable mental tasks for potential brain-computer interface (BCI) applications.Approach.We explore the feasibility of a silent naming task, for the first time in fNIRS, and propose three novel intuitive mental tasks based on imagining concepts using three sensory modalities: visual, auditory, and tactile. Participants are asked to visualize an object in their minds, imagine the sounds made by the object, and imagine the feeling of touching the object. A general linear model is used to extract hemodynamic responses that are then classified via logistic regression in a univariate and multivariate manner.Main results.We successfully classify all tasks with mean accuracies of 76.2% for the silent naming task, 80.9% for the visual imagery task, 72.8% for the auditory imagery task, and 70.4% for the tactile imagery task. Furthermore, we show that consistent neural representations of semantic categories exist by applying classifiers across tasks.Significance.These findings show that semantic decoding is possible in fNIRS. The study is the first step toward the use of semantic decoding for intuitive BCI applications for communication.

Potential pitfalls of widely used implementations of common spatial patterns.

We have uncovered serious flaws in handling EEG signals with a decreased rank in implementations of the common spatial patterns (CSP). The CSP algorithm assumes covariance matrices of the signal to have full rank. However, preprocessing techniques, such as artifact removal using independent component analysis, may decrease the rank of the signal, leading to potential errors in the CSP decomposition. We inspect what could go wrong when CSP implementations do not take this into consideration on a binary motor imagery classification task. We review CSP implementations in open-source toolboxes for EEG signal analysis (FieldTrip, BBCI Toolbox, BioSig, EEGLAB, BCILAB, and MNE). We show that unprotected implementations decreased mean classification accuracy by up to 32%, with spatial filters resulting in complex numbers, for which corresponding spatial patterns do not have a clear interpretation. We encourage researchers to check their implementations and analysis pipelines.

Neural component analysis: source localisation for motor imagery classification.

The electroencephalogram (EEG) records a summed mixture of multiple sources of neural activity distributed throughout the brain. Source separation methods aim to un-mix the EEG in order to recover activity generated by the original sources. However, most current state-of-the-art source separation methods do not take into account the physical locations of sources of EEG activity.We present a new source separation method which uses an accurate model of the head to un-mix the EEG into individual sources based on their physical locations.We apply our method to an EEG dataset recorded during motor imagery and show that it is able to identify sources that are located in distinct physical regions of the brain. We compare our method to independent component analysis and show that our sources have higher spatial specificity and, furthermore, allow higher classification accuracies (a mean improvement in accuracy of 8.6% was achieved p =0.039).

Electroencephalography reflects the activity of sub-cortical brain regions during approach-withdrawal behaviour while listening to music.

The ability of music to evoke activity changes in the core brain structures that underlie the experience of emotion suggests that it has the potential to be used in therapies for emotion disorders. A large volume of research has identified a network of sub-cortical brain regions underlying music-induced emotions. Additionally, separate evidence from electroencephalography (EEG) studies suggests that prefrontal asymmetry in the EEG reflects the approach-withdrawal response to music-induced emotion. However, fMRI and EEG measure quite different brain processes and we do not have a detailed understanding of the functional relationships between them in relation to music-induced emotion. We employ a joint EEG - fMRI paradigm to explore how EEG-based neural correlates of the approach-withdrawal response to music reflect activity changes in the sub-cortical emotional response network. The neural correlates examined are asymmetry in the prefrontal EEG, and the degree of disorder in that asymmetry over time, as measured by entropy. Participants' EEG and fMRI were recorded simultaneously while the participants listened to music that had been specifically generated to target the elicitation of a wide range of affective states. While listening to this music, participants also continuously reported their felt affective states. Here we report on co-variations in the dynamics of these self-reports, the EEG, and the sub-cortical brain activity. We find that a set of sub-cortical brain regions in the emotional response network exhibits activity that significantly relates to prefrontal EEG asymmetry. Specifically, EEG in the pre-frontal cortex reflects not only cortical activity, but also changes in activity in the amygdala, posterior temporal cortex, and cerebellum. We also find that, while the magnitude of the asymmetry reflects activity in parts of the limbic and paralimbic systems, the entropy of that asymmetry reflects activity in parts of the autonomic response network such as the auditory cortex. This suggests that asymmetry magnitude reflects affective responses to music, while asymmetry entropy reflects autonomic responses to music. Thus, we demonstrate that it is possible to infer activity in the limbic and paralimbic systems from pre-frontal EEG asymmetry. These results show how EEG can be used to measure and monitor changes in the limbic and paralimbic systems. Specifically, they suggest that EEG asymmetry acts as an indicator of sub-cortical changes in activity induced by music. This shows that EEG may be used as a measure of the effectiveness of music therapy to evoke changes in activity in the sub-cortical emotion response network. This is also the first time that the activity of sub-cortical regions, normally considered "invisible" to EEG, has been shown to be characterisable directly from EEG dynamics measured during music listening.

Affective brain-computer music interfacing.

OBJECTIVE: We aim to develop and evaluate an affective brain-computer music interface (aBCMI) for modulating the affective states of its users. APPROACH: An aBCMI is constructed to detect a user's current affective state and attempt to modulate it in order to achieve specific objectives (for example, making the user calmer or happier) by playing music which is generated according to a specific affective target by an algorithmic music composition system and a case-based reasoning system. The system is trained and tested in a longitudinal study on a population of eight healthy participants, with each participant returning for multiple sessions. MAIN RESULTS: The final online aBCMI is able to detect its users current affective states with classification accuracies of up to 65% (3 class, [Formula: see text]) and modulate its user's affective states significantly above chance level [Formula: see text]. SIGNIFICANCE: Our system represents one of the first demonstrations of an online aBCMI that is able to accurately detect and respond to user's affective states. Possible applications include use in music therapy and entertainment.

Music-induced emotions can be predicted from a combination of brain activity and acoustic features.

It is widely acknowledged that music can communicate and induce a wide range of emotions in the listener. However, music is a highly-complex audio signal composed of a wide range of complex time- and frequency-varying components. Additionally, music-induced emotions are known to differ greatly between listeners. Therefore, it is not immediately clear what emotions will be induced in a given individual by a piece of music. We attempt to predict the music-induced emotional response in a listener by measuring the activity in the listeners electroencephalogram (EEG). We combine these measures with acoustic descriptors of the music, an approach that allows us to consider music as a complex set of time-varying acoustic features, independently of any specific music theory. Regression models are found which allow us to predict the music-induced emotions of our participants with a correlation between the actual and predicted responses of up to r=0.234,p<0.001. This regression fit suggests that over 20% of the variance of the participant's music induced emotions can be predicted by their neural activity and the properties of the music. Given the large amount of noise, non-stationarity, and non-linearity in both EEG and music, this is an encouraging result. Additionally, the combination of measures of brain activity and acoustic features describing the music played to our participants allows us to predict music-induced emotions with significantly higher accuracies than either feature type alone (p<0.01).

Automated identification of neural correlates of continuous variables.

BACKGROUND: The electroencephalogram (EEG) may be described by a large number of different feature types and automated feature selection methods are needed in order to reliably identify features which correlate with continuous independent variables. NEW METHOD: A method is presented for the automated identification of features that differentiate two or more groups in neurological datasets based upon a spectral decomposition of the feature set. Furthermore, the method is able to identify features that relate to continuous independent variables. RESULTS: The proposed method is first evaluated on synthetic EEG datasets and observed to reliably identify the correct features. The method is then applied to EEG recorded during a music listening task and is observed to automatically identify neural correlates of music tempo changes similar to neural correlates identified in a previous study. Finally, the method is applied to identify neural correlates of music-induced affective states. The identified neural correlates reside primarily over the frontal cortex and are consistent with widely reported neural correlates of emotions. COMPARISON WITH EXISTING METHODS: The proposed method is compared to the state-of-the-art methods of canonical correlation analysis and common spatial patterns, in order to identify features differentiating synthetic event-related potentials of different amplitudes and is observed to exhibit greater performance as the number of unique groups in the dataset increases. CONCLUSIONS: The proposed method is able to identify neural correlates of continuous variables in EEG datasets and is shown to outperform canonical correlation analysis and common spatial patterns.

Neural correlates of emotional responses to music: an EEG study.

This paper presents an EEG study into the neural correlates of music-induced emotions. We presented participants with a large dataset containing musical pieces in different styles, and asked them to report on their induced emotional responses. We found neural correlates of music-induced emotion in a number of frequencies over the pre-frontal cortex. Additionally, we found a set of patterns of functional connectivity, defined by inter-channel coherence measures, to be significantly different between groups of music-induced emotional responses.

Changes in music tempo entrain movement related brain activity.

The neural mechanisms of music listening and appreciation are not yet completely understood. Based on the apparent relationship between the beats per minute (tempo) of music and the desire to move (for example feet tapping) induced while listening to that music it is hypothesised that musical tempo may evoke movement related activity in the brain. Participants are instructed to listen, without moving, to a large range of musical pieces spanning a range of styles and tempos during an electroencephalogram (EEG) experiment. Event-related desynchronisation (ERD) in the EEG is observed to correlate significantly with the variance of the tempo of the musical stimuli. This suggests that the dynamics of the beat of the music may induce movement related brain activity in the motor cortex. Furthermore, significant correlations are observed between EEG activity in the alpha band over the motor cortex and the bandpower of the music in the same frequency band over time. This relationship is observed to correlate with the strength of the ERD, suggesting entrainment of motor cortical activity relates to increased ERD strength.

On the control of brain-computer interfaces by users with cerebral palsy.

OBJECTIVE: Brain-computer interfaces (BCIs) have been proposed as a potential assistive device for individuals with cerebral palsy (CP) to assist with their communication needs. However, it is unclear how well-suited BCIs are to individuals with CP. Therefore, this study aims to investigate to what extent these users are able to gain control of BCIs. METHODS: This study is conducted with 14 individuals with CP attempting to control two standard online BCIs (1) based upon sensorimotor rhythm modulations, and (2) based upon steady state visual evoked potentials. RESULTS: Of the 14 users, 8 are able to use one or other of the BCIs, online, with a statistically significant level of accuracy, without prior training. Classification results are driven by neurophysiological activity and not seen to correlate with occurrences of artifacts. However, many of these users' accuracies, while statistically significant, would require either more training or more advanced methods before practical BCI control would be possible. CONCLUSIONS: The results indicate that BCIs may be controlled by individuals with CP but that many issues need to be overcome before practical application use may be achieved. SIGNIFICANCE: This is the first study to assess the ability of a large group of different individuals with CP to gain control of an online BCI system. The results indicate that six users could control a sensorimotor rhythm BCI and three a steady state visual evoked potential BCI at statistically significant levels of accuracy (SMR accuracies; mean ± STD, 0.821 ± 0.116, SSVEP accuracies; 0.422 ± 0.069).

Event-related desynchronization (ERD) in the alpha band during a hand mental rotation task.

Recent studies have demonstrated that mentally rotating the hands involves participants engaging in motor imagery processing. However, far less is known about the possible neurophysiological basis of such processing. To contribute to a better understanding of hand mental rotation processing, event-related spectral perturbation (ERSP) methods were applied to electroencephalography (EEG) data collected from participants mentally rotating their hands. Time-frequency analyses revealed that alpha-band power suppression was larger over central-parietal regions. This is in accordance with motor imagery findings suggesting that the motor regions may be involved in processing or detection of kinaesthetic information. Furthermore, the presence of a significant negative correlation between reaction times (RTs) and alpha-band power suppression over central regions is illustrated. These findings are consistent with the neural efficiency hypothesis, which proposes the non-use of many brain regions irrelevant for the task performance as well as the more focused use of specific task-related regions in individuals with better performance. These results indicate that ERSP provides some independent insights into the mental rotation process and further confirms that parietal and motor cortices are involved in mental rotation.

Relationship between electrical brain responses to motor imagery and motor impairment in stroke.

BACKGROUND AND PURPOSE: New strategies like motor imagery based brain-computer interfaces, which use brain signals such as event-related desynchronization (ERD) or event-related synchronization (ERS) for motor rehabilitation after a stroke, are undergoing investigation. However, little is known about the relationship between ERD and ERS patterns and the degree of stroke impairment. The aim of this work was to clarify this relationship. METHODS: EEG during motor imagery and execution were measured in 29 patients with first-ever monolateral stroke causing any degree of motor deficit in the upper limb. The strength and laterality of the ERD or ERS patterns were correlated with the scores of the European Stroke Scale, the Medical Research Council, and the Modified Ashworth Scale. RESULTS: Mean age of the patients was 58 ± 15 years; mean time from the incident was 4 ± 4 months. Stroke lesions were cortical (n=8), subcortical (n=11), or mixed (n=10), attributable to either an ischemic event (n=26) or a hemorrhage (n=3), affecting the right (n=16) or left (n=13) hemisphere. Higher impairment was related to stronger ERD in the unaffected hemisphere and higher spasticity was related to stronger ERD in the affected hemisphere. Both were related to a relatively stronger ERS in the affected hemisphere. CONCLUSIONS: The results of this study may have implications for the design of potential poststroke rehabilitation interventions based on brain-computer interface technologies that use neurophysiological signals like ERD or ERS as neural substrates for the mutual interaction between brain and machine and, ultimately, help stroke patients to regain motor control.