TiD-Introducing and Benchmarking an Event-Delivery System for Brain-Computer Interfaces.

In this paper, we present and analyze an event distribution system for brain-computer interfaces. Events are commonly used to mark and describe incidents during an experiment and are therefore critical for later data analysis or immediate real-time processing. The presented approach, called Tools for brain-computer interaction interface D (TiD), delivers messages in XML format via a buslike system using transmission control protocol connections or shared memory. A dedicated server dispatches TiD messages to distributed or local clients. The TiD message is designed to be flexible and contains time stamps for event synchronization, whereas events describe incidents, which occur during an experiment. TiD was tested extensively toward stability and latency. The effect of an occurring event jitter was analyzed and benchmarked on a reference implementation under different conditions as gigabit and 100-Mb Ethernet or Wi-Fi with a different number of event receivers. A 3-dB signal attenuation, which occurs when averaging jitter influenced trials aligned by events, is starting to become visible at around 1-2 kHz in the case of a gigabit connection. Mean event distribution times across operating systems are ranging from 0.3 to 0.5ms for a gigabit network connection for 106 events. Results for other environmental conditions are available in this paper. References already using TiD for event distribution are provided showing the applicability of TiD for event delivery with distributed or local clients.

Transferring brain-computer interfaces beyond the laboratory: successful application control for motor-disabled users.

OBJECTIVES: Brain-computer interfaces (BCIs) are no longer only used by healthy participants under controlled conditions in laboratory environments, but also by patients and end-users, controlling applications in their homes or clinics, without the BCI experts around. But are the technology and the field mature enough for this? Especially the successful operation of applications - like text entry systems or assistive mobility devices such as tele-presence robots - requires a good level of BCI control. How much training is needed to achieve such a level? Is it possible to train naïve end-users in 10 days to successfully control such applications? MATERIALS AND METHODS: In this work, we report our experiences of training 24 motor-disabled participants at rehabilitation clinics or at the end-users' homes, without BCI experts present. We also share the lessons that we have learned through transferring BCI technologies from the lab to the user's home or clinics. RESULTS: The most important outcome is that 50% of the participants achieved good BCI performance and could successfully control the applications (tele-presence robot and text-entry system). In the case of the tele-presence robot the participants achieved an average performance ratio of 0.87 (max. 0.97) and for the text entry application a mean of 0.93 (max. 1.0). The lessons learned and the gathered user feedback range from pure BCI problems (technical and handling), to common communication issues among the different people involved, and issues encountered while controlling the applications. CONCLUSION: The points raised in this paper are very widely applicable and we anticipate that they might be faced similarly by other groups, if they move on to bringing the BCI technology to the end-user, to home environments and towards application prototype control.

Phase-based features for motor imagery brain-computer interfaces.

Motor imagery (MI) brain-computer interfaces (BCIs) translate a subject's motor intention to a command signal. Most MI BCIs use power features in the mu or beta rhythms, while several results have been reported using a measure of phase synchrony, the phase-locking value (PLV). In this study, we investigated the performance of various phase-based features, including instantaneous phase difference (IPD) and PLV, for control of a MI BCI. Patterns of phase synchrony differentially appear over the motor cortices and between the primary motor cortex (M1) and supplementary motor area (SMA) during MI. Offline results, along with preliminary online sessions, indicate that IPD serves as a robust control signal for differentiating between MI classes, and that the phase relations between channels are relatively stable over several months. Offline and online trial-level classification accuracies based on IPD ranged from 84% to 99%, whereas the performance for the corresponding amplitude features ranged from 70% to 100%.

The use of phonetic motor invariants can improve automatic phoneme discrimination.

We investigate the use of phonetic motor invariants (MIs), that is, recurring kinematic patterns of the human phonetic articulators, to improve automatic phoneme discrimination. Using a multi-subject database of synchronized speech and lips/tongue trajectories, we first identify MIs commonly associated with bilabial and dental consonants, and use them to simultaneously segment speech and motor signals. We then build a simple neural network-based regression schema (called Audio-Motor Map, AMM) mapping audio features of these segments to the corresponding MIs. Extensive experimental results show that (a) a small set of features extracted from the MIs, as originally gathered from articulatory sensors, are dramatically more effective than a large, state-of-the-art set of audio features, in automatically discriminating bilabials from dentals; (b) the same features, extracted from AMM-reconstructed MIs, are as effective as or better than the audio features, when testing across speakers and coarticulating phonemes; and dramatically better as noise is added to the speech signal. These results seem to support some of the claims of the motor theory of speech perception and add experimental evidence of the actual usefulness of MIs in the more general framework of automated speech recognition.

Tools for Brain-Computer Interaction: A General Concept for a Hybrid BCI.

The aim of this work is to present the development of a hybrid Brain-Computer Interface (hBCI) which combines existing input devices with a BCI. Thereby, the BCI should be available if the user wishes to extend the types of inputs available to an assistive technology system, but the user can also choose not to use the BCI at all; the BCI is active in the background. The hBCI might decide on the one hand which input channel(s) offer the most reliable signal(s) and switch between input channels to improve information transfer rate, usability, or other factors, or on the other hand fuse various input channels. One major goal therefore is to bring the BCI technology to a level where it can be used in a maximum number of scenarios in a simple way. To achieve this, it is of great importance that the hBCI is able to operate reliably for long periods, recognizing and adapting to changes as it does so. This goal is only possible if many different subsystems in the hBCI can work together. Since one research institute alone cannot provide such different functionality, collaboration between institutes is necessary. To allow for such a collaboration, a new concept and common software framework is introduced. It consists of four interfaces connecting the classical BCI modules: signal acquisition, preprocessing, feature extraction, classification, and the application. But it provides also the concept of fusion and shared control. In a proof of concept, the functionality of the proposed system was demonstrated.

Towards natural non-invasive hand neuroprostheses for daily living.

In this paper we show how healthy subjects can operate a non-invasive asynchronous BCI for controlling a FES neuroprosthesis and manipulate objects to carry out daily tasks in ecological conditions. Both, experienced and novel subjects proved to be able to deliver mental commands with high accuracy and speed. Our neuroprosthetic approach relies on a natural interaction paradigm, where subjects delivers congruent MI commands (i.e., they imagining a movement of the same hand they control through FES). Furthermore, we have tested our approach in a common daily task such as handwriting, which requires the user to split his/her attention to multitask between BCI control, reaching, and the primary handwriting task itself. Interestingly, the very low number of erroneous trials illustrates how during the experiments subjects were able to deliver commands just when they intended to do so. Similarly, the subjects could perform actions while delivering, or preparing to deliver, mental commands.

On the road to a neuroprosthetic hand: a novel hand grasp orthosis based on functional electrical stimulation.

To patients who have lost the functionality of their hands as a result of a severe spinal cord injury or brain stroke, the development of new techniques for grasping is indispensable for reintegration and independency in daily life. Functional Electrical Stimulation (FES) of residual muscles can reproduce the most dominant grasping tasks and can be initialized by brain signals. However, due to the very complex hand anatomy and current limitations in FES-technology with surface electrodes, these grasp patterns cannot be smoothly executed. In this paper, we present an adaptable passive hand orthosis which is capable of producing natural and smooth movements when coupled with FES. It evenly synchronizes the grasping movements and applied forces on all fingers, allowing for naturalistic gestures and functional grasps of everyday objects. The orthosis is also equipped with a lock, which allows it to remain in the desired position without the need for long-term stimulation. Furthermore, we quantify improvements offered by the orthosis compare them with natural grasps on healthy subjects.