Decoding the Preparation Stage of Target Shooting under Audiovisual Restricted Conditions: Investigating Neural Mechanisms Using Microstate Analysis.

Shooting is a fine sport that is greatly influenced by mental state, and the neural activity of brain in the preparation stage of shooting has a direct influence on the level of shooting. In order to explore the brain neural mechanism in the preparation stage of pistol shooting under audiovisual restricted conditions, and to reveal the intrinsic relationship between brain activity and shooting behavior indicators, the electroencephalography (EEG) signals and seven shooting behaviors including shooting performance, gun holding stability, and firing stability, were experimentally captured from 30 shooters, these shooters performed pistol shooting under three conditions, normal, dim, and noisy. Using EEG microstates combined with standardized low-resolution brain electromagnetic tomography (sLORETA) traceability analysis method, we investigated the difference between the microstates characteristics under audiovisual restricted conditions and normal condition, the relationship between the microstates characteristics and the behavioral indicators during the shooting preparation stage under different conditions. The experimental results showed that microstate 1 corresponded to microstate A, microstate 2 corresponded to microstate B, and microstate 4 corresponded to microstate D; Microstate 3 was a unique template, which was localized in the occipital lobe, its function was to generate the "vision for action"; The dim condition significantly reduced the shooter's performance, whereas the noisy condition had less effect on the shooter's performance; In audiovisual restricted conditions, the microstate characteristics were significantly different from those in the normal condition. Microstate 4' parameters decreased significantly while microstate 3' parameters increased significantly under restricted visual and auditory conditions; Dim condition required more shooting skills from the shooter; There was a significant relationship between characteristics of microstates and indicators of shooting behavior; It was concluded that in order to obtain good shooting performance, shooters should improve attention and concentrate on the adjustment of collimator and target's center leveling relation, but the focus was slightly different in the three conditions; Microstates that are more important for accomplishing the task have less variation in their characteristics over time; Similar conclusions to previous studies were obtained at the same time, i.e., increased visual attention prior to shooting is detrimental to shooting performance, and there is a high positive correlation with microstate D for task completion. The experimental results further reveal the brain neural mechanism in the shooting preparation stage, and the extracted neural markers can be used as effective functional indicators for monitoring the brain state in the shooting preparation stage of pistols.

[Ethical considerations for medical applications of implantable brain-computer interfaces].

Implantable brain-computer interfaces (BCIs) have potentially important clinical applications due to the high spatial resolution and signal-to-noise ratio of electrodes that are closer to or implanted in the cerebral cortex. However, the surgery and electrodes of implantable BCIs carry safety risks of brain tissue damage, and their medical applications face ethical challenges, with little literature to date systematically considering ethical norms for the medical applications of implantable BCIs. In order to promote the clinical translation of this type of BCI, we considered the ethics of practice for the medical application of implantable BCIs, including: reducing the risk of brain tissue damage from implantable BCI surgery and electrodes, providing patients with customized and personalized implantable BCI treatments, ensuring multidisciplinary collaboration in the clinical application of implantable BCIs, and the responsible use of implantable BCIs, among others. It is expected that this article will provide thoughts and references for the research and development of ethics of the medical application of implantable BCI.

[Ethics considerations on brain-computer interface technology].

The development and potential application of brain-computer interface (BCI) technology is closely related to the human brain, so that the ethical regulation of BCI has become an important issue attracting the consideration of society. Existing literatures have discussed the ethical norms of BCI technology from the perspectives of non-BCI developers and scientific ethics, while few discussions have been launched from the perspective of BCI developers. Therefore, there is a great need to study and discuss the ethical norms of BCI technology from the perspective of BCI developers. In this paper, we present the user-centered and non-harmful BCI technology ethics, and then discuss and look forward on them. This paper argues that human beings can cope with the ethical issues arising from BCI technology, and as BCI technology develops, its ethical norms will be improved continuously. It is expected that this paper can provide thoughts and references for the formulation of ethical norms related to BCI technology.

Interactive modulations between congruency sequence effects and validity sequence effects.

Sequential modulations have been found in both conflict and spatial orienting tasks. The former is called congruency sequence effects (CSE) and the latter is called validity sequence effects (VSE). Although the two effects have similar phenomenon descriptions, the relationship of the cognitive control mechanisms under the two effects is still unclear. Using a modified attentional network test (ANT), a flanker task and an arrow cueing task are integrated into a single task, which enables the test of the possible interactions between CSE and VSE. Since a confound-minimized design is used, the observed sequence effects cannot be attributed to the feature integration of low-level stimulus features or the contingency learning. It was found that the CSE are only significant when the arrow cue in preceding trial is invalid, and the VSE are only significant when the target letter in preceding trial is congruent with the distractor letters. The findings suggest that the sequential modulations during orienting and executive control of attention networks are highly interacted with each other, and the sequence effects in these networks are possibly controlled by a complex and multifaceted adaptive control mechanism.

[Key technologies for intelligent brain-computer interaction based on magnetoencephalography].

Brain-computer interaction (BCI) is a transformative human-computer interaction, which aims to bypass the peripheral nerve and muscle system and directly convert the perception, imagery or thinking activities of cranial nerves into actions for further improving the quality of human life. Magnetoencephalogram (MEG) measures the magnetic field generated by the electrical activity of neurons. It has the unique advantages of non-contact measurement, high temporal and spatial resolution, and convenient preparation. It is a new BCI driving signal. MEG-BCI research has important brain science significance and potential application value. So far, few documents have elaborated the key technical issues involved in MEG-BCI. Therefore, this paper focuses on the key technologies of MEG-BCI, and details the signal acquisition technology involved in the practical MEG-BCI system, the design of the MEG-BCI experimental paradigm, the MEG signal analysis and decoding key technology, MEG-BCI neurofeedback technology and its intelligent method. Finally, this paper also discusses the existing problems and future development trends of MEG-BCI. It is hoped that this paper will provide more useful ideas for MEG-BCI innovation research.

[Neurofeedback technology based on functional near infrared spectroscopy imaging and its applications].

Neurofeedback (NF) technology based on electroencephalogram (EEG) data or functional magnetic resonance imaging (fMRI) has been widely studied and applied. In contrast, functional near infrared spectroscopy (fNIRS) has become a new technique in NF research in recent years. fNIRS is a neuroimaging technology based on hemodynamics, which has the advantages of low cost, good portability and high spatial resolution, and is more suitable for use in natural environments. At present, there is a lack of comprehensive review on fNIRS-NF technology (fNIRS-NF) in China. In order to provide a reference for the research of fNIRS-NF technology, this paper first describes the principle, key technologies and applications of fNIRS-NF, and focuses on the application of fNIRS-NF. Finally, the future development trend of fNIRS-NF is prospected and summarized. In conclusion, this paper summarizes fNIRS-NF technology and its application, and concludes that fNIRS-NF technology has potential practicability in neurological diseases and related fields. fNIRS can be used as a good method for NF training. This paper is expected to provide reference information for the development of fNIRS-NF technology.

[Applications, industrial transformation and commercial value of brain-computer interface technology].

Brain-computer interface (BCI) is a revolutionary human-computer interaction technology, which includes both BCI that can output instructions directly from the brain to external devices or machines without relying on the peripheral nerve and muscle system, and BCI that bypasses the peripheral nerve and muscle system and inputs electrical, magnetic, acoustic and optical stimuli or neural feedback directly to the brain from external devices or machines. With the development of BCI technology, it has potential application not only in medical field, but also in non-medical fields, such as education, military, finance, entertainment, smart home and so on. At present, there is little literature on the relevant application of BCI technology, the current situation of BCI industrialization at home and abroad and its commercial value. Therefore, this paper expounds and discusses the above contents, which are expected to provide valuable information for the public and organizations, BCI researchers, BCI industry translators and salespeople, and improve the cognitive level of BCI technology, further promote the application and industrial transformation of BCI technology and enhance the commercial value of BCI, so as to serve mankind better.

[Key technology of brain-computer interaction based on speech imagery].

Speech expression is an important high-level cognitive behavior of human beings. The realization of this behavior is closely related to human brain activity. Both true speech expression and speech imagination can activate part of the same brain area. Therefore, speech imagery becomes a new paradigm of brain-computer interaction. Brain-computer interface (BCI) based on speech imagery has the advantages of spontaneous generation, no training, and friendliness to subjects, so it has attracted the attention of many scholars. However, this interactive technology is not mature in the design of experimental paradigms and the choice of imagination materials, and there are many issues that need to be discussed urgently. Therefore, in response to these problems, this article first expounds the neural mechanism of speech imagery. Then, by reviewing the previous BCI research of speech imagery, the mainstream methods and core technologies of experimental paradigm, imagination materials, data processing and so on are systematically analyzed. Finally, the key problems and main challenges that restrict the development of this type of BCI are discussed. And the future development and application perspective of the speech imaginary BCI system are prospected.

[Human factors engineering of brain-computer interface and its applications: Human-centered brain-computer interface design and evaluation methodology].

Brain-computer interface (BCI) is a revolutionizing human-computer Interaction, which is developing towards the direction of intelligent brain-computer interaction and brain-computer intelligent integration. However, the practical application of BCI is facing great challenges. The maturity of BCI technology has not yet reached the needs of users. The traditional design method of BCI needs to be improved. It is necessary to pay attention to BCI human factors engineering, which plays an important role in narrowing the gap between research and practical application, but it has not attracted enough attention and has not been specifically discussed in depth. Aiming at BCI human factors engineering, this article expounds the design requirements (from users), design ideas, objectives and methods, as well as evaluation indexes of BCI with the human-centred-design. BCI human factors engineering is expected to make BCI system design under different use conditions more in line with human characteristics, abilities and needs, improve the user satisfaction of BCI system, enhance the user experience of BCI system, improve the intelligence of BCI, and make BCI move towards practical application.

[Execution, assessment and improvement methods of motor imagery for brain-computer interface].

Motor imagery (MI) is an important paradigm of driving brain computer interface (BCI). However, MI is not easy to control or acquire, and the performance of MI-BCI depends heavily on the performance of the subjects' MI. Therefore, the correct execution of MI mental activities, ability evaluation and improvement methods play important and even critical roles in the improvement and application of MI-BCI system's performance. However, in the research and development of MI-BCI, the existing researches mainly focus on the decoding algorithm of MI, but do not pay enough attention to the above three aspects of MI mental activities. In this paper, these problems of MI-BCI are discussed in detail, and it is pointed out that the subjects tend to use visual motor imagery as kinesthetic motor imagery. In the future, we need to develop some objective, quantitatively visualized MI ability evaluation methods, and develop some effective and less time-consumption training methods to improve MI ability. It is also necessary to solve the differences and commonness of MI problems between and within individuals and MI-BCI illiteracy to a certain extent.

[Recognition of three different imagined movement of the right foot based on functional near-infrared spectroscopy].

Brain-computer interface (BCI) based on functional near-infrared spectroscopy (fNIRS) is a new-type human-computer interaction technique. To explore the separability of fNIRS signals in different motor imageries on the single limb, the study measured the fNIRS signals of 15 subjects (amateur football fans) during three different motor imageries of the right foot (passing, stopping and shooting). And the correlation coefficient of the HbO signal during different motor imageries was extracted as features for the input of a three-classification model based on support vector machines. The results found that the classification accuracy of the three motor imageries of the right foot was 78.89%±6.161%. The classification accuracy of the two-classification of motor imageries of the right foot, that is, passing and stopping, passing and shooting, and stopping and shooting was 85.17%±4.768%, 82.33%±6.011%, and 89.33%±6.713%, respectively. The results demonstrate that the fNIRS of different motor imageries of the single limb is separable, which is expected to add new control commands to fNIRS-BCI and also provide a new option for rehabilitation training and control peripherals for unilateral stroke patients. Besides, the study also confirms that the correlation coefficient can be used as an effective feature to classify different motor imageries.

Single-Trial Recognition of Imagined Forces and Speeds of Hand Clenching Based on Brain Topography and Brain Network.

To provide optional force and speed control parameters for brain-computer interfaces (BCIs), an effective feature extraction method of imagined force and speed of hand clenching based on electroencephalography (EEG) was explored. Twenty subjects were recruited to participate in the experiment. They were instructed to perform three different actual/imagined hand clenching force tasks (4 kg, 10 kg, and 16 kg) and three different hand clenching speed tasks (0.5 Hz, 1 Hz, and 2 Hz). Topographical maps parameters and brain network parameters of EEG were calculated as new features of imagined force and speed of hand clenching, which were classified by three classifiers: linear discrimination analysis, extreme learning machines and support vector machines. Topographical maps parameters were better for recognition of the hand clenching force task, while brain network parameters were better for recognition of the hand clenching speed task. After a combination of five types of features (energy, power spectrum of the autoregressive model, wavelet packet coefficients, topographical maps parameters and brain network parameters), the recognition rate of the hand clenching force task was 97%, and that of the hand clenching speed task was as high as 100%. The brain topographical and the brain network parameters are expected to improve the accuracy of decoding the EEG signal of imagined force and speed of hand clenching. A more efficient brain network may facilitate the recognition of force/speed of hand clenching. Combined features could significantly improve the single-trial recognition rate of imagined forces and speeds of hand clenching. The current study provides a new idea for the imagined force and speed of hand clenching that offers more control intention instructions for BCIs.

[Control of intelligent car based on electroencephalogram and neurofeedback].

To improve the performance of brain-controlled intelligent car based on motor imagery (MI), a method based on neurofeedback (NF) with electroencephalogram (EEG) for controlling intelligent car is proposed. A mental strategy of MI in which the energy column diagram of EEG features related to the mental activity is presented to subjects with visual feedback in real time to train them to quickly master the skills of MI and regulate their EEG activity, and combination of multi-features fusion of MI and multi-classifiers decision were used to control the intelligent car online. The average, maximum and minimum accuracy of identifying instructions achieved by the trained group (trained by the designed feedback system before the experiment) were 85.71%, 90.47% and 76.19%, respectively and the corresponding accuracy achieved by the control group (untrained) were 73.32%, 80.95% and 66.67%, respectively. For the trained group, the average, longest and shortest time consuming were 92 s, 101 s, and 85 s, respectively, while for the control group the corresponding time were 115.7 s, 120 s, and 110 s, respectively. According to the results described above, it is expected that this study may provide a new idea for the follow-up development of brain-controlled intelligent robot by the neurofeedback with EEG related to MI.

[Direct brain-controlled multi-robot cooperation task].

Brain control is a new control method. The traditional brain-controlled robot is mainly used to control a single robot to accomplish a specific task. However, the brain-controlled multi-robot cooperation (MRC) task is a new topic to be studied. This paper presents an experimental research which received the "Innovation Creative Award" in the brain-computer interface (BCI) brain-controlled robot contest at the World Robot Contest. Two effective brain switches were set: total control brain switch and transfer switch, and BCI based steady-state visual evoked potentials (SSVEP) was adopted to navigate a humanoid robot and a mechanical arm to complete the cooperation task. Control test of 10 subjects showed that the excellent SSVEP-BCI can be used to achieve the MRC task by appropriately setting up the brain switches. This study is expected to provide inspiration for the future practical brain-controlled MRC task system.

[Design and experiment of a multi-modal electroencephalogram-near infrared spectroscopy helmet for simultaneously acquiring at the same brain area].

Multi-modal brain-computer interface and multi-modal brain function imaging are developing trends for the present and future. Aiming at multi-modal brain-computer interface based on electroencephalogram-near infrared spectroscopy (EEG-NIRS) and in order to simultaneously acquire the brain activity of motor area, an acquisition helmet by NIRS combined with EEG was designed and verified by the experiment. According to the 10-20 system or 10-20 extended system, the diameter and spacing of NIRS probe and EEG electrode, NIRS probes were aligned with C3 and C4 as the reference electrodes, and NIRS probes were placed in the middle position between EEG electrodes to simultaneously measure variations of NIRS and the corresponding variation of EEG in the same functional brain area. The clamp holder and near infrared probe were coupled by tightening a screw. To verify the feasibility and effectiveness of the multi-modal EEG-NIRS helmet, NIRS and EEG signals were collected from six healthy subjects during six mental tasks involving the right hand clenching force and speed motor imagery. These signals may reflect brain activity related to hand clenching force and speed motor imagery in a certain extent. The experiment showed that the EEG-NIRS helmet designed in the paper was feasible and effective. It not only could provide support for the multi-modal motor imagery brain-computer interface based on EEG-NIRS, but also was expected to provide support for multi-modal brain functional imaging based on EEG-NIRS.

[Pretreatment Research Based on Left and Right Hand Motor Imagery for Single-channel Electroencephalogram].

Most of electroencephalogram(EEG)acquired by multi-channels is difficult to be applied to the singlechannel brain-computer interface(BCI)in the EEG analysis method based on left and right hand motor imagery.The present research applied an improved independent component analysis(ICA)method to realize pretreatment of the EEG effectively.Firstly,data drift was removed through linear drift correction.Secondly,the number of virtual channels were increased by applying delayed window data and some EEG artifacts which are namely electrooculogram(EOG)and electrocardiogram(ECG)were removed by ICA.Finally,the average instantaneous energy characteristics were calculated and classified through the instantaneous amplitude which was solved by applying Hilbert-Huang transform(HHT).The experiment proves that the method completes the EEG pretreatment and improves classification ratio of single-channel EEG,and lays a foundation of single-channel and portable BCI.

Classification of hemodynamic responses associated with force and speed imagery for a brain-computer interface.

Functional near-infrared spectroscopy (fNIRS) is an emerging optical technique, which can assess brain activities associated with tasks. In this study, six participants were asked to perform three imageries of hand clenching associated with force and speed, respectively. Joint mutual information (JMI) criterion was used to extract the optimal features of hemodynamic responses. And extreme learning machine (ELM) was employed to be the classifier. ELM solved the major bottleneck of feedforward neural networks in learning speed, this classifier was easily implemented and less sensitive to specified parameters. The 2-class fNIRS-BCI system was firstly built with an average accuracy of 76.7%, when all force and speed tasks were categorized as one class, respectively. The multi-class systems based on different levels of force and speed attempted to be investigated, the accuracies were moderate. This study provided a novel paradigm for establishing fNIRS-BCI system, and provided a possibility to produce more degrees of freedom in BCI system.

Enhanced performance by time-frequency-phase feature for EEG-based BCI systems.

We introduce a new motor parameter imagery paradigm using clench speed and clench force motor imagery. The time-frequency-phase features are extracted from mu rhythm and beta rhythms, and the features are optimized using three process methods: no-scaled feature using "MIFS" feature selection criterion, scaled feature using "MIFS" feature selection criterion, and scaled feature using "mRMR" feature selection criterion. Support vector machines (SVMs) and extreme learning machines (ELMs) are compared for classification between clench speed and clench force motor imagery using the optimized feature. Our results show that no significant difference in the classification rate between SVMs and ELMs is found. The scaled feature combinations can get higher classification accuracy than the no-scaled feature combinations at significant level of 0.01, and the "mRMR" feature selection criterion can get higher classification rate than the "MIFS" feature selection criterion at significant level of 0.01. The time-frequency-phase feature can improve the classification rate by about 20% more than the time-frequency feature, and the best classification rate between clench speed motor imagery and clench force motor imagery is 92%. In conclusion, the motor parameter imagery paradigm has the potential to increase the direct control commands for BCI control and the time-frequency-phase feature has the ability to improve BCI classification accuracy.

Differential Brain Activation for Four Emotions in VR-2D and VR-3D Modes.

Similar to traditional imaging, virtual reality (VR) imagery encompasses nonstereoscopic (VR-2D) and stereoscopic (VR-3D) modes. Currently, Russell's emotional model has been extensively studied in traditional 2D and VR-3D modes, but there is limited comparative research between VR-2D and VR-3D modes. In this study, we investigate whether Russell's emotional model exhibits stronger brain activation states in VR-3D mode compared to VR-2D mode. By designing an experiment covering four emotional categories (high arousal-high pleasure (HAHV), high arousal-low pleasure (HALV), low arousal-low pleasure (LALV), and low arousal-high pleasure (LAHV)), EEG signals were collected from 30 healthy undergraduate and graduate students while watching videos in both VR modes. Initially, power spectral density (PSD) computations revealed distinct brain activation patterns in different emotional states across the two modes, with VR-3D videos inducing significantly higher brainwave energy, primarily in the frontal, temporal, and occipital regions. Subsequently, Differential entropy (DE) feature sets, selected via a dual ten-fold cross-validation Support Vector Machine (SVM) classifier, demonstrate satisfactory classification accuracy, particularly superior in the VR-3D mode. The paper subsequently presents a deep learning-based EEG emotion recognition framework, adeptly utilizing the frequency, spatial, and temporal information of EEG data to improve recognition accuracy. The contribution of each individual feature to the prediction probabilities is discussed through machine-learning interpretability based on Shapley values. The study reveals notable differences in brain activation states for identical emotions between the two modes, with VR-3D mode showing more pronounced activation.

Comprehensive evaluation methods for translating BCI into practical applications: usability, user satisfaction and usage of online BCI systems.

Although brain-computer interface (BCI) is considered a revolutionary advancement in human-computer interaction and has achieved significant progress, a considerable gap remains between the current technological capabilities and their practical applications. To promote the translation of BCI into practical applications, the gold standard for online evaluation for classification algorithms of BCI has been proposed in some studies. However, few studies have proposed a more comprehensive evaluation method for the entire online BCI system, and it has not yet received sufficient attention from the BCI research and development community. Therefore, the qualitative leap from analyzing and modeling for offline BCI data to the construction of online BCI systems and optimizing their performance is elaborated, and then user-centred is emphasized, and then the comprehensive evaluation methods for translating BCI into practical applications are detailed and reviewed in the article, including the evaluation of the usability (including effectiveness and efficiency of systems), the evaluation of the user satisfaction (including BCI-related aspects, etc.), and the evaluation of the usage (including the match between the system and user, etc.) of online BCI systems. Finally, the challenges faced in the evaluation of the usability and user satisfaction of online BCI systems, the efficacy of online BCI systems, and the integration of BCI and artificial intelligence (AI) and/or virtual reality (VR) and other technologies to enhance the intelligence and user experience of the system are discussed. It is expected that the evaluation methods for online BCI systems elaborated in this review will promote the translation of BCI into practical applications.