Mapping and decoding cortical engagement during motor imagery, mental arithmetic, and silent word generation using MEG.

Accurate quantification of cortical engagement during mental imagery tasks remains a challenging brain-imaging problem with immediate relevance to developing brain-computer interfaces. We analyzed magnetoencephalography (MEG) data from 18 individuals completing cued motor imagery, mental arithmetic, and silent word generation tasks. Participants imagined movements of both hands (HANDS) and both feet (FEET), subtracted two numbers (SUB), and silently generated words (WORD). The task-related cortical engagement was inferred from beta band (17-25 Hz) power decrements estimated using a frequency-resolved beamforming method. In the hands and feet motor imagery tasks, beta power consistently decreased in premotor and motor areas. In the word and subtraction tasks, beta-power decrements showed engagements in language and arithmetic processing within the temporal, parietal, and inferior frontal regions. A support vector machine classification of beta power decrements yielded high accuracy rates of 74 and 68% for classifying motor-imagery (HANDS vs. FEET) and cognitive (WORD vs. SUB) tasks, respectively. From the motor-versus-nonmotor contrasts, excellent accuracy rates of 85 and 80% were observed for hands-versus-word and hands-versus-sub, respectively. A multivariate Gaussian-process classifier provided an accuracy rate of 60% for the four-way (HANDS-FEET-WORD-SUB) classification problem. Individual task performance was revealed by within-subject correlations of beta-decrements. Beta-power decrements are helpful metrics for mapping and decoding cortical engagement during mental processes in the absence of sensory stimuli or overt behavioral outputs. Markers derived based on beta decrements may be suitable for rehabilitation purposes, to characterize motor or cognitive impairments, or to treat patients recovering from a cerebral stroke.

A magnetoencephalography dataset for motor and cognitive imagery-based brain-computer interface.

Recent advancements in magnetoencephalography (MEG)-based brain-computer interfaces (BCIs) have shown great potential. However, the performance of current MEG-BCI systems is still inadequate and one of the main reasons for this is the unavailability of open-source MEG-BCI datasets. MEG systems are expensive and hence MEG datasets are not readily available for researchers to develop effective and efficient BCI-related signal processing algorithms. In this work, we release a 306-channel MEG-BCI data recorded at 1KHz sampling frequency during four mental imagery tasks (i.e. hand imagery, feet imagery, subtraction imagery, and word generation imagery). The dataset contains two sessions of MEG recordings performed on separate days from 17 healthy participants using a typical BCI imagery paradigm. The current dataset will be the only publicly available MEG imagery BCI dataset as per our knowledge. The dataset can be used by the scientific community towards the development of novel pattern recognition machine learning methods to detect brain activities related to motor imagery and cognitive imagery tasks using MEG signals.

Effects of maternal folic acid supplementation during the second and third trimesters of pregnancy on neurocognitive development in the child: an 11-year follow-up from a randomised controlled trial.

BACKGROUND: Maternal folic acid (FA) supplementation before and in early pregnancy prevents neural tube defects (NTD), but it is uncertain whether continuing FA after the first trimester has benefits on offspring health. We aimed to evaluate the effect of FA supplementation throughout pregnancy on cognitive performance and brain function in the child. METHODS: Follow-up investigation of 11-year-old children, residing in Northern Ireland, whose mothers had participated in a randomised trial of Folic Acid Supplementation in the Second and Third Trimesters (FASSTT) in pregnancy and received 400 µg/day FA or placebo from the 14th gestational week. Cognitive performance (Full Scale Intelligence Quotient, Verbal Comprehension, Working Memory, Perceptual Reasoning, and Processing Speed) was assessed using the Wechsler Intelligence Scale for Children. Neuronal function was assessed using magnetoencephalographic (MEG) brain imaging. RESULTS: Of 119 mother-child pairs in the FASSTT trial, 68 children were assessed for neurocognitive performance at 11-year follow-up (Dec 2017 to Nov 2018). Children of mothers randomised to FA compared with placebo scored significantly higher in two Processing Speed tests, i.e. symbol search (mean difference 2.9 points, 95% CI 0.3 to 5.5, p = 0.03) and cancellation (11.3 points, 2.5 to 20.1, p = 0.04), whereas the positive effect on Verbal Comprehension was significant in girls only (6.5 points, 1.2 to 11.8, p = 0.03). MEG assessment of neuronal responses to a language task showed increased power at the Beta (13-30 Hz, p = 0.01) and High Gamma (49-70 Hz, p = 0.04) bands in children from FA-supplemented mothers, suggesting more efficient semantic processing of language. CONCLUSIONS: Continued FA supplementation in pregnancy beyond the early period currently recommended to prevent NTD can benefit neurocognitive development of the child. MEG provides a non-invasive tool in paediatric research to objectively assess functional brain activity in response to nutrition and other interventions. TRIAL REGISTRATION: ISRCTN ISRCTN19917787 . Registered on 15 May 2013.

Assessing impact of channel selection on decoding of motor and cognitive imagery from MEG data.

OBJECTIVE: Magnetoencephalography (MEG) based brain-computer interface (BCI) involves a large number of sensors allowing better spatiotemporal resolution for assessing brain activity patterns. There have been many efforts to develop BCI using MEG with high accuracy, though an increase in the number of channels (NoC) means an increase in computational complexity. However, not all sensors necessarily contribute significantly to an increase in classification accuracy (CA) and specifically in the case of MEG-based BCI no channel selection methodology has been performed. Therefore, this study investigates the effect of channel selection on the performance of MEG-based BCI. APPROACH: MEG data were recorded for two sessions from 15 healthy participants performing motor imagery, cognitive imagery and a mixed imagery task pair using a unique paradigm. Performance of four state-of-the-art channel selection methods (i.e. Class-Correlation, ReliefF, Random Forest, and Infinite Latent Feature Selection were applied across six binary tasks in three different frequency bands) were evaluated in this study on two state-of-the-art features, i.e. bandpower and common spatial pattern (CSP). MAIN RESULTS: All four methods provided a statistically significant increase in CA compared to a baseline method using all gradiometer sensors, i.e. 204 channels with band-power features from alpha (8-12 Hz), beta (13-30 Hz), or broadband (α + ß) (8-30 Hz). It is also observed that the alpha frequency band performed better than the beta and broadband frequency bands. The performance of the beta band gave the lowest CA compared with the other two bands. Channel selection improved accuracy irrespective of feature types. Moreover, all the methods reduced the NoC significantly, from 204 to a range of 1-25, using bandpower as a feature and from 15 to 105 for CSP. The optimal channel number also varied not only in each session but also for each participant. Reducing the NoC will help to decrease the computational cost and maintain numerical stability in cases of low trial numbers. SIGNIFICANCE: The study showed significant improvement in performance of MEG-BCI with channel selection irrespective of feature type and hence can be successfully applied for BCI applications.

Active Physical Practice Followed by Mental Practice Using BCI-Driven Hand Exoskeleton: A Pilot Trial for Clinical Effectiveness and Usability.

Appropriately combining mental practice (MP) and physical practice (PP) in a poststroke rehabilitation is critical for ensuring a substantially positive rehabilitation outcome. Here, we present a rehabilitation protocol incorporating a separate active PP stage followed by MP stage, using a hand exoskeleton and brain-computer interface (BCI). The PP stage was mediated by a force sensor feedback-based assist-as-needed control strategy, whereas the MP stage provided BCI-based multimodal neurofeedback combining anthropomorphic visual feedback and proprioceptive feedback of the impaired hand extension attempt. A six week long clinical trial was conducted on four hemiparetic stroke patients (screened out of 16) with a left-hand disability. The primary outcome, motor functional recovery, was measured in terms of changes in grip-strength (GS) and action research arm test (ARAT) scores; whereas the secondary outcome, usability of the system was measured in terms of changes in mood, fatigue, and motivation on a visual-analog-scale. A positive rehabilitative outcome was found as the group mean changes from the baseline in the GS and ARAT were +6.38 kg and +5.66 accordingly. The VAS scale measurements also showed betterment in mood ( 1.38), increased motivation (+2.10) and reduced fatigue (0.98) as compared to the baseline. Thus, the proposed neurorehabilitation protocol is found to be promising both in terms of clinical effectiveness and usability.

Single-trial effective brain connectivity patterns enhance discriminability of mental imagery tasks.

OBJECTIVE: The majority of the current approaches of connectivity based brain-computer interface (BCI) systems focus on distinguishing between different motor imagery (MI) tasks. Brain regions associated with MI are anatomically close to each other, hence these BCI systems suffer from low performances. Our objective is to introduce single-trial connectivity feature based BCI system for cognition imagery (CI) based tasks wherein the associated brain regions are located relatively far away as compared to those for MI. APPROACH: We implemented time-domain partial Granger causality (PGC) for the estimation of the connectivity features in a BCI setting. The proposed hypothesis has been verified with two publically available datasets involving MI and CI tasks. MAIN RESULTS: The results support the conclusion that connectivity based features can provide a better performance than a classical signal processing framework based on bandpass features coupled with spatial filtering for CI tasks, including word generation, subtraction, and spatial navigation. These results show for the first time that connectivity features can provide a reliable performance for imagery-based BCI system. SIGNIFICANCE: We show that single-trial connectivity features for mixed imagery tasks (i.e. combination of CI and MI) can outperform the features obtained by current state-of-the-art method and hence can be successfully applied for BCI applications.

Temporal Information of Directed Causal Connectivity in Multi-Trial ERP Data using Partial Granger Causality.

Partial Granger causality (PGC) has been applied to analyse causal functional neural connectivity after effectively mitigating confounding influences caused by endogenous latent variables and exogenous environmental inputs. However, it is not known how this connectivity obtained from PGC evolves over time. Furthermore, PGC has yet to be tested on realistic nonlinear neural circuit models and multi-trial event-related potentials (ERPs) data. In this work, we first applied a time-domain PGC technique to evaluate simulated neural circuit models, and demonstrated that the PGC measure is more accurate and robust in detecting connectivity patterns as compared to conditional Granger causality and partial directed coherence, especially when the circuit is intrinsically nonlinear. Moreover, the connectivity in PGC settles faster into a stable and correct configuration over time. After method verification, we applied PGC to reveal the causal connections of ERP trials of a mismatch negativity auditory oddball paradigm. The PGC analysis revealed a significant bilateral but asymmetrical localised activity in the temporal lobe close to the auditory cortex, and causal influences in the frontal, parietal and cingulate cortical areas, consistent with previous studies. Interestingly, the time to reach a stable connectivity configuration (~250­300 ms) coincides with the deviation of ensemble ERPs of oddball from standard tones. Finally, using a sliding time window, we showed higher resolution dynamics of causal connectivity within an ERP trial. In summary, time-domain PGC is promising in deciphering directed functional connectivity in nonlinear and ERP trials accurately, and at a sufficiently early stage. This data-driven approach can reduce computational time, and determine the key architecture for neural circuit modeling.

Signal Propagation in the Human Visual Pathways: An Effective Connectivity Analysis.

Although the visual system has been extensively investigated, an integrated account of the spatiotemporal dynamics of long-range signal propagation along the human visual pathways is not completely known or validated. In this work, we used dynamic causal modeling approach to provide insights into the underlying neural circuit dynamics of pattern reversal visual-evoked potentials extracted from concurrent EEG-fMRI data. A recurrent forward-backward connectivity model, consisting of multiple interacting brain regions identified by EEG source localization aided by fMRI spatial priors, best accounted for the data dynamics. Sources were first identified in the thalamic area, primary visual cortex, as well as higher cortical areas along the ventral and dorsal visual processing streams. Consistent with hierarchical early visual processing, the model disclosed and quantified the neural temporal dynamics across the identified activity sources. This signal propagation is dominated by a feedforward process, but we also found weaker effective feedback connectivity. Using effective connectivity analysis, the optimal dynamic causal modeling revealed enhanced connectivity along the dorsal pathway but slightly suppressed connectivity along the ventral pathway. A bias was also found in favor of the right hemisphere consistent with functional attentional asymmetry. This study validates, for the first time, the long-range signal propagation timing in the human visual pathways. A similar modeling approach can potentially be used to understand other cognitive processes and dysfunctions in signal propagation in neurological and neuropsychiatric disorders. Significance statement: An integrated account of long-range visual signal propagation in the human brain is currently incomplete. Using computational neural modeling on our acquired concurrent EEG-fMRI data under a visual evoked task, we found not only a substantial forward propagation toward "higher-order" brain regions but also a weaker backward propagation. Asymmetry in our model's long-range connectivity accounted for the various observed activity biases. Importantly, the model disclosed the timing of signal propagation across these connectivity pathways and validates, for the first time, long-range signal propagation in the human visual system. A similar modeling approach could be used to identify neural pathways for other cognitive processes and their dysfunctions in brain disorders.

Towards increasing the number of commands in a hybrid brain-computer interface with combination of gaze and motor imagery.

Non-invasive brain-computer interface (BCI) provides a novel means of communication. This can be achieved by measuring electroencephalogram (EEG) signal over the sensory motor cortex of a person performing motor imagery (MI) tasks. However, the performance of BCI remains currently too low to be of wide practical use. A hybrid BCI system could improve the performance by combining two or more modalities such as eye tracking, and the detection of brain activity responses. In this paper, first, we propose a simultaneous hybrid BCI that combines an event-related de-synchronization (ERD) BCI and an eye tracker. Second, we aim to further improve performance by increasing the number of commands (i.e., the number of choices accessible to the user). In particular, we show a significant improvement in performance for a simultaneous gaze-MI system using a total of eight commands. The experimental task requires subjects to search for spatially located items using gaze, and select an item using MI signals. This experimental task studied visuomotor compatible and incompatible conditions. As incorporating incompatible conditions between gaze direction and MI can increase the number of choices in the hybrid BCI, our experimental task includes single-trial detection for average, compatible and incompatible conditions, using seven different classification methods. The mean accuracy for MI, and the information transfer rate (ITR) for the compatible condition is found to be higher than the average and the incompatible conditions. The results suggest that gaze-MI hybrid BCI systems can increase the number of commands, and the location of the items should be taken into account for designing the system.

Is sensorimotor BCI performance influenced differently by mono, stereo, or 3-D auditory feedback?

Imagination of movement can be used as a control method for a brain-computer interface (BCI) allowing communication for the physically impaired. Visual feedback within such a closed loop system excludes those with visual problems and hence there is a need for alternative sensory feedback pathways. In the context of substituting the visual channel for the auditory channel, this study aims to add to the limited evidence that it is possible to substitute visual feedback for its auditory equivalent and assess the impact this has on BCI performance. Secondly, the study aims to determine for the first time if the type of auditory feedback method influences motor imagery performance significantly. Auditory feedback is presented using a stepped approach of single (mono), double (stereo), and multiple (vector base amplitude panning as an audio game) loudspeaker arrangements. Visual feedback involves a ball-basket paradigm and a spaceship game. Each session consists of either auditory or visual feedback only with runs of each type of feedback presentation method applied in each session. Results from seven subjects across five sessions of each feedback type (visual, auditory) (10 sessions in total) show that auditory feedback is a suitable substitute for the visual equivalent and that there are no statistical differences in the type of auditory feedback presented across five sessions.

Sensorimotor learning with stereo auditory feedback for a brain-computer interface.

Motor imagery can be used to modulate sensorimotor rhythms (SMR) enabling detection of voltage fluctuations on the surface of the scalp using electroencephalographic electrodes. Feedback is essential in learning to modulate SMR for non-muscular communication using a brain-computer interface (BCI). A BCI not reliant upon the visual modality not only releases the visual channel for other uses but also offers an attractive means of communication for the physically impaired who are also blind or vision impaired. This study demonstrates the feasibility of replacing the traditional visual feedback modality with stereo auditory feedback. Results from a pilot study were used to select the most appropriate sounds for auditory feedback based on three options: broadband noise and two anechoic instrument samples. Subsequently, an SMR BCI was used to examine the effect on sensorimotor learning with broadband noise utilising a modified stereophonic presentation method. Twenty participants split into equal groups took part in ten sessions. The visual group performed best initially but did not improve over time whilst the auditory group improved as the study progressed. The results demonstrate the feasibility of using stereophonic auditory feedback with broadband noise as opposed to other auditory feedback presentation methods and sounds which are less intuitive.

Learning to modulate sensorimotor rhythms with stereo auditory feedback for a brain-computer interface.

Motor imagery can be used to modulate sensorimotor rhythms (SMR) enabling detection of voltage fluctuations on the surface of the scalp using electroencephalographic (EEG) electrodes. Feedback is essential in learning how to intentionally modulate SMR in non-muscular communication using a brain-computer interface (BCI). A BCI that is not reliant upon the visual modality for feedback is an attractive means of communication for the blind and the vision impaired and to release the visual channel for other purposes during BCI usage. The aim of this study is to demonstrate the feasibility of replacing the traditional visual feedback modality with stereo auditory feedback. Twenty participants split into equal groups took part in ten BCI sessions involving motor imagery. The visual feedback group performed best using two performance measures but did not show improvement over time whilst the auditory group improved as the study progressed. Multiple loudspeaker presentation of audio allows the listener to intuitively assign each of two classes to the corresponding lateral position in a free-field listening environment.

Applying a brain-computer interface to support motor imagery practice in people with stroke for upper limb recovery: a feasibility study.

BACKGROUND: There is now sufficient evidence that using a rehabilitation protocol involving motor imagery (MI) practice in conjunction with physical practice (PP) of goal-directed rehabilitation tasks leads to enhanced functional recovery of paralyzed limbs among stroke sufferers. It is however difficult to confirm patient engagement during an MI in the absence of any on-line measure. Fortunately an EEG-based brain-computer interface (BCI) can provide an on-line measure of MI activity as a neurofeedback for the BCI user to help him/her focus better on the MI task. However initial performance of novice BCI users may be quite moderate and may cause frustration. This paper reports a pilot study in which a BCI system is used to provide a computer game-based neurofeedback to stroke participants during the MI part of a protocol. METHODS: The participants included five chronic hemiplegic stroke sufferers. Participants received up to twelve 30-minute MI practice sessions (in conjunction with PP sessions of the same duration) on 2 days a week for 6 weeks. The BCI neurofeedback performance was evaluated based on the MI task classification accuracy (CA) rate. A set of outcome measures including action research arm test (ARAT) and grip strength (GS), was made use of in assessing the upper limb functional recovery. In addition, since stroke sufferers often experience physical tiredness, which may influence the protocol effectiveness, their fatigue and mood levels were assessed regularly. RESULTS: Positive improvement in at least one of the outcome measures was observed in all the participants, while improvements approached a minimal clinically important difference (MCID) for the ARAT. The on-line CA of MI induced sensorimotor rhythm (SMR) modulation patterns in the form of lateralized event-related desynchronization (ERD) and event-related synchronization (ERS) effects, for novice participants was in a moderate range of 60-75% within the limited 12 training sessions. The ERD/ERS change from the first to the last session was statistically significant for only two participants. CONCLUSIONS: Overall the crucial observation is that the moderate BCI classification performance did not impede the positive rehabilitation trends as quantified with the rehabilitation outcome measures adopted in this study. Therefore it can be concluded that the BCI supported MI is a feasible intervention as part of a post-stroke rehabilitation protocol combining both PP and MI practice of rehabilitation tasks. Although these findings are promising, the scope of the final conclusions is limited by the small sample size and the lack of a control group.

Creating a nonparametric brain-computer interface with neural time-series prediction preprocessing.

The issue of subject-specific parameter selection in an electroencephalogram (EEG)-based brain-computer interface (BCI) is tackled in this paper. Hjorth- and Barlow-based feature extraction procedures (FEPs) are investigated along with linear discriminant analysis (LDA) for classification. These are well-known nonparametric FEPs but their simplicity prevents them from matching the performance of more complex FEPs. Neural time-series prediction preprocessing (NTSPP) has been shown to enhance the separability of both time- and frequency-based features and is used in this work to improve the applicability of these FEPs. NTSPP uses a number of prediction modules (PMs) to perform m-step ahead prediction of EEG time-series recorded whilst subjects perform motor imagery-based mental tasks. Depending on the PMs, the NTSPP framework normally requires subject-specific parameters to be predefined. In this work each PM is a self-organizing fuzzy neural network (SOFNN). The SOFNN has a self-organizing structure and good nonlinear approximation capabilities however; a number of parameters must be defined prior to training. This is problematic therefore the practicality of a general set of parameters, previously selected via a sensitivity analysis (SA), is analyzed. The results indicate that a general set of NTSPP parameters may provide the best results and therefore a fully nonparametric BCI may be realizable.