Pure visual imagery as a potential approach to achieve three classes of control for implementation of BCI in non-motor disorders.

OBJECTIVE: The achievement of multiple instances of control with the same type of mental strategy represents a way to improve flexibility of brain-computer interface (BCI) systems. Here we test the hypothesis that pure visual motion imagery of an external actuator can be used as a tool to achieve three classes of electroencephalographic (EEG) based control, which might be useful in attention disorders. APPROACH: We hypothesize that different numbers of imagined motion alternations lead to distinctive signals, as predicted by distinct motion patterns. Accordingly, a distinct number of alternating sensory/perceptual signals would lead to distinct neural responses as previously demonstrated using functional magnetic resonance imaging (fMRI). We anticipate that differential modulations should also be observed in the EEG domain. EEG recordings were obtained from twelve participants using three imagery tasks: imagery of a static dot, imagery of a dot with two opposing motions in the vertical axis (two motion directions) and imagery of a dot with four opposing motions in vertical or horizontal axes (four directions). The data were analysed offline. MAIN RESULTS: An increase of alpha-band power was found in frontal and central channels as a result of visual motion imagery tasks when compared with static dot imagery, in contrast with the expected posterior alpha decreases found during simple visual stimulation. The successful classification and discrimination between the three imagery tasks confirmed that three different classes of control based on visual motion imagery can be achieved. The classification approach was based on a support vector machine (SVM) and on the alpha-band relative spectral power of a small group of six frontal and central channels. Patterns of alpha activity, as captured by single-trial SVM closely reflected imagery properties, in particular the number of imagined motion alternations. SIGNIFICANCE: We found a new mental task based on visual motion imagery with potential for the implementation of multiclass (3) BCIs. Our results are consistent with the notion that frontal alpha synchronization is related with high internal processing demands, changing with the number of alternation levels during imagery. Together, these findings suggest the feasibility of pure visual motion imagery tasks as a strategy to achieve multiclass control systems with potential for BCI and in particular, neurofeedback applications in non-motor (attentional) disorders.

Control of Brain Activity in hMT+/V5 at Three Response Levels Using fMRI-Based Neurofeedback/BCI.

A major challenge in brain-computer interface (BCI) research is to increase the number of command classes and levels of control. BCI studies often use binary control level approaches (level 0 and 1 of brain activation for each class of control). Different classes may often be achieved but not different levels of activation for the same class. The increase in the number of levels of control in BCI applications may allow for larger efficiency in neurofeedback applications. In this work we test the hypothesis whether more than two modulation levels can be achieved in a single brain region, the hMT+/V5 complex. Participants performed three distinct imagery tasks during neurofeedback training: imagery of a stationary dot, imagery of a dot with two opposing motions in the vertical axis and imagery of a dot with four opposing motions in vertical or horizontal axes (imagery of 2 or 4 motion directions). The larger the number of motion alternations, the higher the expected hMT+/V5 response. A substantial number (17 of 20) of participants achieved successful binary level of control and 12 were able to reach even 3 significant levels of control within the same session, confirming the whole group effects at the individual level. With this simple approach we suggest that it is possible to design a parametric system of control based on activity modulation of a specific brain region with at least 3 different levels. Furthermore, we show that particular imagery task instructions, based on different number of motion alternations, provide feasible achievement of different control levels in BCI and/or neurofeedback applications.

Toward a reliable gaze-independent hybrid BCI combining visual and natural auditory stimuli.

BACKGROUND: Brain computer interfaces (BCIs) are one of the last communication options for patients in the locked-in state (LIS). For complete LIS patients, interfaces must be gaze-independent due to their eye impairment. However, unimodal gaze-independent approaches typically present levels of performance substantially lower than gaze-dependent approaches. The combination of multimodal stimuli has been pointed as a viable way to increase users' performance. NEW METHOD: A hybrid visual and auditory (HVA) P300-based BCI combining simultaneously visual and auditory stimulation is proposed. Auditory stimuli are based on natural meaningful spoken words, increasing stimuli discrimination and decreasing user's mental effort in associating stimuli to the symbols. The visual part of the interface is covertly controlled ensuring gaze-independency. RESULTS: Four conditions were experimentally tested by 10 healthy participants: visual overt (VO), visual covert (VC), auditory (AU) and covert HVA. Average online accuracy for the hybrid approach was 85.3%, which is more than 32% over VC and AU approaches. Questionnaires' results indicate that the HVA approach was the less demanding gaze-independent interface. Interestingly, the P300 grand average for HVA approach coincides with an almost perfect sum of P300 evoked separately by VC and AU tasks. COMPARISON WITH EXISTING METHODS: The proposed HVA-BCI is the first solution simultaneously embedding natural spoken words and visual words to provide a communication lexicon. Online accuracy and task demand of the approach compare favorably with state-of-the-art. CONCLUSIONS: The proposed approach shows that the simultaneous combination of visual covert control and auditory modalities can effectively improve the performance of gaze-independent BCIs.