Is there a continuum of agentive awareness across physical and mental actions? The case of quasi-movements.

While humans routinely distinguish between physical and mental actions, overt movements (OM) and kinesthetically imagined movements (IM) are often viewed as forming a continuum of activities. Here, we theoretically conceptualized this continuum hypothesis for agentive awareness related to OM and IM and tested it experimentally using quasi-movements (QM), a little studied type of covert actions, which is considered as an inner part of the OM-IM continuum. QM are performed when a movement attempt is minimized down to full extinction of overt movement and muscle activity. We asked participants to perform OM, IM and QM and collected their electromyography data. According to participants' reports, they experienced QM as OM in terms of intentions and expected sensory feedback, while the verbal descriptors were independent from muscle activation. These results do not fit the OM-QM-IM continuum and suggest qualitative distinction for agentive awareness between IM and QM/OM.

An experimental paradigm for studying sense of agency in joint human-machine motor actions.

In this paper, we propose an experimental technique for studying the sense of agency (SoA) in joint human-machine actions. This technique is based on the use of an electromechanical finger-lifting device that enables a joint motor action initiated by a participant and completed by the machine. The joint action, later referred to as an "active-passive" action, was implemented as a reaction time task and contrasted with other levels of participant's involvement, including active movement, passive movement, and observation of a dummy's movement. In each trial, a feedback sound signal informed the participant whether they had performed the task successfully, i.e. faster than a threshold, which was individually adjusted in the beginning of the experiment. In the active condition, the result depended on the participant, while in other conditions it was preprogrammed for the servo. In context of this task, we studied direct time estimates made by participants and auditory event-related potentials (ERP) in 20 healthy volunteers. The amplitude of the auditory N1 component in the responses to the feedback sound showed no significant effect of activity and success factors, while its latency was shorter in successful trials. Interaction of activity and success factors was significant for subjective time estimates. Surprisingly, the intentional binding effect (subjective compression of time intervals, which is known as a correlate of SoA) only emerged in trials of active condition with negative results. This observation was in contrast with the fact that the active and active-passive movements were both voluntarily initiated by the participant. We believe that studying SoA with the proposed technique may not only add to the understanding of agency but also provide practically relevant results for the development of human-machine systems such as exoskeletons.

Quasi-Movements and "Quasi-Quasi-Movements": Does Residual Muscle Activation Matter?

Quasi-movements (QM) are observed when an individual minimizes a movement to an extent that no related muscle activation is detected. Likewise to imaginary movements (IM) and overt movements, QMs are accompanied by the event-related desynchronization (ERD) of EEG sensorimotor rhythms. Stronger ERD was observed under QMs compared to IMs in some studies. However, the difference could be caused by the remaining muscle activation in QMs that could escape detection. Here, we re-examined the relation between the electromyography (EMG) signal and ERD in QM using sensitive data analysis procedures. More trials with signs of muscle activation were observed in QMs compared with a visual task and IMs. However, the rate of such trials was not correlated with subjective estimates of actual movement. Contralateral ERD did not depend on the EMG but still was stronger in QMs compared with IMs. These results suggest that brain mechanisms are common for QMs in the strict sense and "quasi-quasi-movements" (attempts to perform the same task accompanied by detectable EMG elevation) but differ between them and IMs. QMs could be helpful in research aimed at better understanding motor action and at modeling the use of attempted movements in the brain-computer interfaces with healthy participants.

MEG-Based Detection of Voluntary Eye Fixations Used to Control a Computer.

Gaze-based input is an efficient way of hand-free human-computer interaction. However, it suffers from the inability of gaze-based interfaces to discriminate voluntary and spontaneous gaze behaviors, which are overtly similar. Here, we demonstrate that voluntary eye fixations can be discriminated from spontaneous ones using short segments of magnetoencephalography (MEG) data measured immediately after the fixation onset. Recently proposed convolutional neural networks (CNNs), linear finite impulse response filters CNN (LF-CNN) and vector autoregressive CNN (VAR-CNN), were applied for binary classification of the MEG signals related to spontaneous and voluntary eye fixations collected in healthy participants (n = 25) who performed a game-like task by fixating on targets voluntarily for 500 ms or longer. Voluntary fixations were identified as those followed by a fixation in a special confirmatory area. Spontaneous vs. voluntary fixation-related single-trial 700 ms MEG segments were non-randomly classified in the majority of participants, with the group average cross-validated ROC AUC of 0.66 ± 0.07 for LF-CNN and 0.67 ± 0.07 for VAR-CNN (M ± SD). When the time interval, from which the MEG data were taken, was extended beyond the onset of the visual feedback, the group average classification performance increased up to 0.91. Analysis of spatial patterns contributing to classification did not reveal signs of significant eye movement impact on the classification results. We conclude that the classification of MEG signals has a certain potential to support gaze-based interfaces by avoiding false responses to spontaneous eye fixations on a single-trial basis. Current results for intention detection prior to gaze-based interface's feedback, however, are not sufficient for online single-trial eye fixation classification using MEG data alone, and further work is needed to find out if it could be used in practical applications.

A passive BCI for monitoring the intentionality of the gaze-based moving object selection.

Objective.The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behavior is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements.Approach.Eighteen participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection.Main results.A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved.Significance.The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g. in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.

Association between year of birth and cognitive functions in Russia and the Czech Republic: cross-sectional results of the HAPIEE study.

OBJECTIVES: To assess differences in cognitive functions by year of birth in Russia and the Czech Republic. METHODS: A cross-sectional study in the general population of Novosibirsk (Russia) and 6 cities of the Czech Republic recruited random samples of men and women (3,874 Russians, 3,626 Czechs) aged 45-69 years in 2002 (i.e. born in 1933-1957). Word recall, verbal fluency (number of animals named in 1 min) and letter search were assessed in a clinic. RESULTS: Except letter search in men, we found similar levels of cognitive functioning in Russians and Czechs in the youngest subjects and a steeper association of functioning with year of birth in Russia than in the Czech Republic. For example, the difference in the mean word recall, associated with 10 years difference in year of birth, was 0.9 (SE 0.06) words in Russian men, compared to 0.4 (0.06) words in Czech men; in women, these figures were 0.8 (0.05) and 0.3 (0.05), respectively. For all outcomes, except letter search in men, the interactions between year of birth and country were statistically highly significant, and the differences in the year of birth effects between countries were largely unexplained by socioeconomic indicators and risk factors. CONCLUSION: The slope of association between lower cognitive functioning and earlier year of birth is much steeper in Russia than in the Czech Republic. Given that poor cognitive functioning is a risk factor for dementia, long-term follow-up of this cohort and other studies into population rates of cognitive impairment in Russia should be a priority.

EEG Negativity in Fixations Used for Gaze-Based Control: Toward Converting Intentions into Actions with an Eye-Brain-Computer Interface.

We usually look at an object when we are going to manipulate it. Thus, eye tracking can be used to communicate intended actions. An effective human-machine interface, however, should be able to differentiate intentional and spontaneous eye movements. We report an electroencephalogram (EEG) marker that differentiates gaze fixations used for control from spontaneous fixations involved in visual exploration. Eight healthy participants played a game with their eye movements only. Their gaze-synchronized EEG data (fixation-related potentials, FRPs) were collected during game's control-on and control-off conditions. A slow negative wave with a maximum in the parietooccipital region was present in each participant's averaged FRPs in the control-on conditions and was absent or had much lower amplitude in the control-off condition. This wave was similar but not identical to stimulus-preceding negativity, a slow negative wave that can be observed during feedback expectation. Classification of intentional vs. spontaneous fixations was based on amplitude features from 13 EEG channels using 300 ms length segments free from electrooculogram contamination (200-500 ms relative to the fixation onset). For the first fixations in the fixation triplets required to make moves in the game, classified against control-off data, a committee of greedy classifiers provided 0.90 ± 0.07 specificity and 0.38 ± 0.14 sensitivity. Similar (slightly lower) results were obtained for the shrinkage Linear Discriminate Analysis (LDA) classifier. The second and third fixations in the triplets were classified at lower rate. We expect that, with improved feature sets and classifiers, a hybrid dwell-based Eye-Brain-Computer Interface (EBCI) can be built using the FRP difference between the intended and spontaneous fixations. If this direction of BCI development will be successful, such a multimodal interface may improve the fluency of interaction and can possibly become the basis for a new input device for paralyzed and healthy users, the EBCI "Wish Mouse."

Trimmed estimators for robust averaging of event-related potentials.

Averaging (in statistical terms, estimation of the location of data) is one of the most commonly used procedures in neuroscience and the basic procedure for obtaining event-related potentials (ERP). Only the arithmetic mean is routinely used in the current practice of ERP research, though its sensitivity to outliers is well-known. Weighted averaging is sometimes used as a more robust procedure, however, it can be not sufficiently appropriate when the signal is nonstationary within a trial. Trimmed estimators provide an alternative way to average data. In this paper, a number of such location estimators (trimmed mean, Winsorized mean and recently introduced trimmed L-mean) are reviewed, as well as arithmetic mean and median. A new robust location estimator tanh, which allows the data-dependent optimization, is proposed for averaging of small number of trials. The possibilities to improve signal-to-noise ratio (SNR) of averaged waveforms using trimmed location estimators are demonstrated for epochs randomly drawn from a set of real auditory evoked potential data.

EEG filtering based on blind source separation (BSS) for early detection of Alzheimer's disease.

OBJECTIVE: Development of an EEG preprocessing technique for improvement of detection of Alzheimer's disease (AD). The technique is based on filtering of EEG data using blind source separation (BSS) and projection of components which are possibly sensitive to cortical neuronal impairment found in early stages of AD. METHODS: Artifact-free 20s intervals of raw resting EEG recordings from 22 patients with Mild Cognitive Impairment (MCI) who later proceeded to AD and 38 age-matched normal controls were decomposed into spatio-temporally decorrelated components using BSS algorithm 'AMUSE'. Filtered EEG was obtained by back projection of components with the highest linear predictability. Relative power of filtered data in delta, theta, alpha 1, alpha 2, beta 1, and beta 2 bands were processed with Linear Discriminant Analysis (LDA). RESULTS: Preprocessing improved the percentage of correctly classified patients and controls computed with jack-knifing cross-validation from 59 to 73% and from 76 to 84%, correspondingly. CONCLUSIONS: The proposed approach can significantly improve the sensitivity and specificity of EEG based diagnosis. SIGNIFICANCE: Filtering based on BSS can improve the performance of the existing EEG approaches to early diagnosis of Alzheimer's disease. It may also have potential for improvement of EEG classification in other clinical areas or fundamental research. The developed method is quite general and flexible, allowing for various extensions and improvements.

A P300-based brain-computer interface with stimuli on moving objects: four-session single-trial and triple-trial tests with a game-like task design.

Brain-computer interfaces (BCIs) are tools for controlling computers and other devices without using muscular activity, employing user-controlled variations in signals recorded from the user's brain. One of the most efficient noninvasive BCIs is based on the P300 wave of the brain's response to stimuli and is therefore referred to as the P300 BCI. Many modifications of this BCI have been proposed to further improve the BCI's characteristics or to better adapt the BCI to various applications. However, in the original P300 BCI and in all of its modifications, the spatial positions of stimuli were fixed relative to each other, which can impose constraints on designing applications controlled by this BCI. We designed and tested a P300 BCI with stimuli presented on objects that were freely moving on a screen at a speed of 5.4°/s. Healthy participants practiced a game-like task with this BCI in either single-trial or triple-trial mode within four sessions. At each step, the participants were required to select one of nine moving objects. The mean online accuracy of BCI-based selection was 81% in the triple-trial mode and 65% in the single-trial mode. A relatively high P300 amplitude was observed in response to targets in most participants. Self-rated interest in the task was high and stable over the four sessions (the medians in the 1st/4th sessions were 79/84% and 76/71% in the groups practicing in the single-trial and triple-trial modes, respectively). We conclude that the movement of stimulus positions relative to each other may not prevent the efficient use of the P300 BCI by people controlling their gaze, e.g., in robotic devices and in video games.

Event-related potentials in a moving matrix modification of the P300 brain-computer interface paradigm.

In the standard design of the brain-computer interfaces (BCI) based on the P300 component of the event-related potentials (ERP), target and non-target stimuli are presented at fixed positions in a motionless matrix. Can we let this matrix be moving (e.g., if attached to a robot) without loosing the efficiency of BCI? We assessed changes of the positive peak at Pz in the time interval 300-500 ms after the stimulus onset (P300) and the negative peak at the occipital electrodes in the range 140-240 ms (N1), both important for the operation of the P300 BCI, during fixating a target cell of a moving matrix in healthy participants (n=12). N1 amplitude in the difference (target-non-target) waveforms decreased with the velocity, although remained high (M=-4.3, SD=2.1) even at highest velocity (20°/s). In general, the amplitudes and latencies of these ERP components were remarkably stable in studied types of matrix movement and all velocities of horizontal movement (5, 10 and 20°/s) comparing to matrix in fixed position. These data suggest that, for the users controlling their gaze, the P300 BCI design can be extended to modifications requiring stimuli matrix motion.