Spiking image processing unit based on neural analog of Boolean logic operations.

McCulloch and Pitts hypothesized in 1943 that the brain is entirely composed of logic gates, akin to current computers' IP cores, which led to several neural analogs of Boolean logic. The current study proposes a spiking image processing unit (SIPU) based on spiking frequency gates and coordinate logic operations, as a dynamical model of synapses and spiking neurons. SIPU can imitate DSP functions like edge recognition, picture magnification, noise reduction, etc. but can be extended to cater for more advanced computing tasks. The proposed spiking Boolean logic platform can be used to develop advanced applications without relying on learning or specialized datasets. It could aid in gaining a deeper understanding of complex brain functions and spur new forms of neural analogs.

Effects of risk factors on longitudinal changes in brain structure and function in the progression of AD.

INTRODUCTION: Past research on Alzheimer's disease (AD) has focused on biomarkers, cognition, and neuroimaging as primary predictors of its progression, albeit additional ones have recently gained attention. When turning to the prediction of the progression from one stage to another, one could benefit from the joint assessment of imaging-based biomarkers and risk/protective factors. METHODS: We included 86 studies that fulfilled our inclusion criteria. RESULTS: Our review summarizes and discusses the results of 30 years of longitudinal research on brain changes assessed with neuroimaging and the risk/protective factors and their effect on AD progression. We group results into four sections: genetic, demographic, cognitive and cardiovascular, and lifestyle factors. DISCUSSION: Given the complex nature of AD, including risk factors could prove invaluable for a better understanding of AD progression. Some of these risk factors are modifiable and could be targeted by potential future treatments.

Real-Time Navigation in Google Street View® Using a Motor Imagery-Based BCI.

Navigation in virtual worlds is ubiquitous in games and other virtual reality (VR) applications and mainly relies on external controllers. As brain-computer interfaces (BCI)s rely on mental control, bypassing traditional neural pathways, they provide to paralyzed users an alternative way to navigate. However, the majority of BCI-based navigation studies adopt cue-based visual paradigms, and the evoked brain responses are encoded into navigation commands. Although robust and accurate, these paradigms are less intuitive and comfortable for navigation compared to imagining limb movements (motor imagery, MI). However, decoding motor imagery from EEG activity is notoriously challenging. Typically, wet electrodes are used to improve EEG signal quality, including a large number of them to discriminate between movements of different limbs, and a cuedbased paradigm is used instead of a self-paced one to maximize decoding performance. Motor BCI applications primarily focus on typing applications or on navigating a wheelchair-the latter raises safety concerns-thereby calling for sensors scanning the environment for obstacles and potentially hazardous scenarios. With the help of new technologies such as virtual reality (VR), vivid graphics can be rendered, providing the user with a safe and immersive experience; and they could be used for navigation purposes, a topic that has yet to be fully explored in the BCI community. In this study, we propose a novel MI-BCI application based on an 8-dry-electrode EEG setup, with which users can explore and navigate in Google Street View®. We pay attention to system design to address the lower performance of the MI decoder due to the dry electrodes' lower signal quality and the small number of electrodes. Specifically, we restricted the number of navigation commands by using a novel middle-level control scheme and avoided decoder mistakes by introducing eye blinks as a control signal in different navigation stages. Both offline and online experiments were conducted with 20 healthy subjects. The results showed acceptable performance, even given the limitations of the EEG set-up, which we attribute to the design of the BCI application. The study suggests the use of MI-BCI in future games and VR applications for consumers and patients temporarily or permanently devoid of muscle control.

Cognitive tasks propagate the neural entrainment in response to a visual 40 Hz stimulation in humans.

Introduction: Alzheimer's disease is one of the great challenges in the coming decades, and despite great efforts, a widely effective disease-modifying therapy in humans remains elusive. One particular promising non-pharmacological therapy that has received increased attention in recent years is based on the Gamma ENtrainment Using Sensory stimulation (GENUS), a high-frequency neural response elicited by a visual and/or auditory stimulus at 40 Hz. While this has shown to be effective in animal models, studies on human participants have reported varying success. The current work hypothesizes that the varying success in humans is due to differences in cognitive workload during the GENUS sessions. Methods: We recruited a cohort of 15 participants who underwent a scalp-EEG recording as well as one epilepsy patient who was implanted with 50 subdural surface electrodes over temporo-occipital and temporo-basal cortex and 14 depth contacts that targeted the hippocampus and insula. All participants completed several GENUS sessions, in each of which a different cognitive task was performed. Results: We found that the inclusion of a cognitive task during the GENUS session not only has a positive effect on the strength and extent of the gamma entrainment, but also promotes the propagation of gamma entrainment to additional neural areas including deep ones such as hippocampus which were not recruited when no cognitive task was required from the participants. The latter is of particular interest given that the hippocampal complex is considered to be one of the primary targets for AD therapies. Discussion: This work introduces a possible improvement strategy for GENUS therapy that might contribute to increasing the efficacy of the therapy or shortening the time needed for the positive outcome.

Towards predicting ECoG-BCI performance: assessing the potential of scalp-EEG.

Objective. Implanted brain-computer interfaces (BCIs) employ neural signals to control a computer and may offer an alternative communication channel for people with locked-in syndrome (LIS). Promising results have been obtained using signals from the sensorimotor (SM) area. However, in earlier work on home-use of an electrocorticography (ECoG)-based BCI by people with LIS, we detected differences in ECoG-BCI performance, which were related to differences in the modulation of low frequency band (LFB) power in the SM area. For future clinical implementation of ECoG-BCIs, it will be crucial to determine whether reliable performance can be predicted before electrode implantation. To assess if non-invasive scalp-electroencephalography (EEG) could serve such prediction, we here investigated if EEG can detect the characteristics observed in the LFB modulation of ECoG signals.Approach. We included three participants with LIS of the earlier study, and a control group of 20 healthy participants. All participants performed a Rest task, and a Movement task involving actual (healthy) or attempted (LIS) hand movements, while their EEG signals were recorded.Main results.Data of the Rest task was used to determine signal-to-noise ratio, which showed a similar range for LIS and healthy participants. Using data of the Movement task, we selected seven EEG electrodes that showed a consistent movement-related decrease in beta power (13-30 Hz) across healthy participants. Within the EEG recordings of this subset of electrodes of two LIS participants, we recognized the phenomena reported earlier for the LFB in their ECoG recordings. Specifically, strong movement-related beta band suppression was observed in one, but not the other, LIS participant, and movement-related alpha band (8-12 Hz) suppression was practically absent in both. Results of the third LIS participant were inconclusive due to technical issues with the EEG recordings.Significance. Together, these findings support a potential role for scalp EEG in the presurgical assessment of ECoG-BCI candidates.

Analytic beamformer transformation for transfer learning in motion-onset visual evoked potential decoding.

Objective.While decoders of electroencephalography-based event-related potentials (ERPs) are routinely tailored to the individual user to maximize performance, developing them on populations for individual usage has proven much more challenging. We propose the analytic beamformer transformation (ABT) to extract phase and/or magnitude information from spatiotemporal ERPs in response to motion-onset stimulation.Approach.We have tested ABT on 52 motion-onset visual evoked potential (mVEP) datasets from 26 healthy subjects and compared the classification accuracy of support vector machine (SVM), spatiotemporal beamformer (stBF) and stepwise linear discriminant analysis (SWLDA) when trained on individual subjects and on a population thereof.Main results.When using phase- and combined phase/magnitude information extracted by ABT, we show significant improvements in accuracy of population-trained classifiers applied to individual users (p< 0.001). We also show that 450 epochs are needed for a correct functioning of ABT, which corresponds to 2 min of paradigm stimulation.Significance.We have shown that ABT can be used to create population-trained mVEP classifiers using a limited number of epochs. We expect this to pertain to other ERPs or synchronous stimulation paradigms, allowing for a more effective, population-based training of visual BCIs. Finally, as ABT renders recordings across subjects more structurally invariant, it could be used for transfer learning purposes in view of plug-and-play BCI applications.

Phase-Spatial Beamforming Renders a Visual Brain Computer Interface Capable of Exploiting EEG Electrode Phase Shifts in Motion-Onset Target Responses.

OBJECTIVE: in this work, we aim to develop a more efficient visual motion-onset based Brain-computer interface (BCI). Brain-computer interfaces provide communication facilities that do not rely on the brain's usual pathways. Visual BCIs are based on changes in EEG activity in response to attended flashing or flickering targets. A less taxing way to encode such targets is with briefly moving stimuli, the onset of which elicits a lateralized EEG potential over the parieto-occipital scalp area called the motion-onset visual evoked potential (mVEP). METHODS: We recruited 21 healthy subjects for an experiment in which motion-onset stimulations translating leftwards (LT) or rightwards (RT) were encoding 9 displayed targets. We propose a novel algorithm that exploits the phase-shift between EEG electrodes to improve target decoding performance. We hereto extend the spatiotemporal beamformer (stBF) with a phase extracting procedure, leading to the phase-spatial beamformer (psBF). RESULTS: we show that psBF performs significantly better than the stBF (p < 0.001 for 1 and 2 stimulus repetitions and p < 0.01 for 3 to 5 stimulus repetitions), as well as the previously validated linear support-vector machines (p < 0.001 for 5 stimulus repetitions and p < 0.01 for 1,2 and 6 stimulus repetitions) and stepwise linear discriminant analysis decoders (p < 0.001 for all repetitions) when simultaneously addressing timing and translation direction. CONCLUSION: We provide evidence of decodability of joint direction and target in mVEP responses. SIGNIFICANCE: the described methods can aid in the development of a faster and more comfortable BCI based on mVEPs.

Chronic Study on Brainwave Authentication in a Real-Life Setting: An LSTM-Based Bagging Approach.

With the advent of the digital age, concern about how to secure authorized access to sensitive data is increasing. Besides traditional authentication methods, there is an interest in biometric traits such as fingerprints, the iris, facial characteristics, and, recently, brainwaves, primarily based on electroencephalography (EEG). Current work on EEG-based authentication focuses on acute recordings in laboratory settings using high-end equipment, typically equipped with 64 channels and operating at a high sampling rate. In this work, we validated the feasibility of EEG-based authentication in a real-world, out-of-laboratory setting using a commercial dry-electrode EEG headset and chronic recordings on a population of 15 healthy people. We used an LSTM-based network with bootstrap aggregating (bagging) to decode our recordings in response to a multitask scheme consisting of performed and imagined motor tasks, and showed that it improved the performance of the standard LSTM approach. We achieved an authentication accuracy, false acceptance rate (FAR), and false rejection rate (FRR) of 92.6%, 2.5%, and 5.0% for the performed motor task; 92.5%, 2.6%, and 4.9% for the imagined motor task; and 93.0%, 1.9%, and 5.1% for the combined tasks, respectively. We recommend the proposed method for time- and data-limited scenarios.

Practical real-time MEG-based neural interfacing with optically pumped magnetometers.

BACKGROUND: Brain-computer interfaces decode intentions directly from the human brain with the aim to restore lost functionality, control external devices or augment daily experiences. To combine optimal performance with wide applicability, high-quality brain signals should be captured non-invasively. Magnetoencephalography (MEG) is a potent candidate but currently requires costly and confining recording hardware. The recently developed optically pumped magnetometers (OPMs) promise to overcome this limitation, but are currently untested in the context of neural interfacing. RESULTS: In this work, we show that OPM-MEG allows robust single-trial analysis which we exploited in a real-time 'mind-spelling' application yielding an average accuracy of 97.7%. CONCLUSIONS: This shows that OPM-MEG can be used to exploit neuro-magnetic brain responses in a practical and flexible manner, and opens up new avenues for a wide range of new neural interface applications in the future.

Electrophysiological Proxy of Cognitive Reserve Index.

Cognitive reserve (CR) postulates that individual differences in task performance can be attributed to differences in the brain's ability to recruit additional networks or adopt alternative cognitive strategies. Variables that are descriptive of lifetime experience such as socioeconomic status, educational attainment, and leisure activity are common proxies of CR. CR is mostly studied using neuroimaging techniques such as functional MRI (fMRI) in which case individuals with a higher CR were observed to activate a smaller brain network compared to individuals with a lower CR, when performing a task equally effectively (higher efficiency), and electroencephalography (EEG) where a particular EEG component (P300) that reflects the attention and working memory load, has been targeted. Despite the contribution of multiple factors such as age, education (formal and informal), working, leisure, and household activities in CR formation, most neuroimaging studies, and those using EEG in particular, focus on formal education level only. The aim of the current EEG study is to investigate how the P300 component, evoked in response to an oddball paradigm, is associated with other components of CR besides education, such as working and leisure activity in older adults. We have used hereto a recently introduced CR index questionnaire (CRIq) that quantifies both professional and leisure activities in terms of their cognitive demand and number of years practiced, as well as a data-driven approach for EEG analysis. We observed complex relationships between CRIq subcomponents and P300 characteristics. These results are especially important given that, unlike previous studies, our measurements (P300 and CRIq) do not require active use of the same executive function and, thus, render our results free of a collinearity bias.

Accurate Offline Asynchronous Detection of Individual Finger Movement From Intracranial Brain Signals Using a Novel Multiway Approach.

Asynchronous motor Brain Computer Interfacing (BCI) is characterized by the continuous decoding of intended muscular activity from brain signals. Such applications have gained widespread interest for enabling users to issue commands volitionally. In conventional motor BCIs features extracted from brain signals are concatenated into vector- or matrix-based (or one-/two-way) representations. Nevertheless, when accounting for the original multimodal or multiway signal structure, decoding performance has been shown to improve jointly with result interpretability. However, as multiway decoders are notorious for the extensive computational cost to train them, conventional ones are still preferred. To curb this limitation, we introduce a novel multiway classifier, called Block-Term Tensor Classifier that inherits the improved accuracy of multiway methods while providing fast training. We show that it can outperform state-of-the-art multiway and two-way Linear Discriminant Analysis classifiers in asynchronous detection of individual finger movements from intracranial recordings, an essential feature to achieve a sense of dexterity with hand prosthetics and exoskeletons.

N-Back Related ERPs Depend on Stimulus Type, Task Structure, Pre-processing, and Lab Factors.

The N-Back, a common working memory (WM) updating task, is increasingly used in basic and applied psychological research. As such, an increasing number of electroencephalogram (EEG) studies have sought to identify the electrophysiological signatures of N-Back task performance. However, stimulus type, task structure, pre-processing methods, and differences in the laboratory environment, including the EEG recording setup employed, greatly vary across studies, which in turn may introduce inconsistencies in the obtained results. Here we address this issue by conducting nine different variations of an N-Back task manipulating stimulus type and task structure. Furthermore, we explored the effect of the pre-processing method used and differences in the laboratory environment. Results reveal significant differences in behavioral and electrophysiological signatures in response to N-Back stimulus type, task structure, pre-processing method, and laboratory environment. In conclusion, we suggest that experimental factors, analysis pipeline, and laboratory differences, which are often ignored in the literature, need to be accounted for when interpreting findings and making comparisons across studies.

Localization of deep brain activity with scalp and subdural EEG.

To what extent electrocorticography (ECoG) and electroencephalography (scalp EEG) differ in their capability to locate sources of deep brain activity is far from evident. Compared to EEG, the spatial resolution and signal-to-noise ratio of ECoG is superior but its spatial coverage is more restricted, as is arguably the volume of tissue activity effectively measured from. Moreover, scalp EEG studies are providing evidence of locating activity from deep sources such as the hippocampus using high-density setups during quiet wakefulness. To address this question, we recorded a multimodal dataset from 4 patients with refractory epilepsy during quiet wakefulness. This data comprises simultaneous scalp, subdural and depth EEG electrode recordings. The latter was located in the hippocampus or insula and provided us with our "ground truth" for source localization of deep activity. We applied independent component analysis (ICA) for the purpose of separating the independent sources in theta, alpha and beta frequency band activity. In all patients subdural- and scalp EEG components were observed which had a significant zero-lag correlation with one or more contacts of the depth electrodes. Subsequent dipole modeling of the correlating components revealed dipole locations that were significantly closer to the depth electrodes compared to the dipole location of non-correlating components. These findings support the idea that components found in both recording modalities originate from neural activity in close proximity to the depth electrodes. Sources localized with subdural electrodes were ~70% closer to the depth electrode than sources localized with EEG with an absolute improvement of around ~2cm. In our opinion, this is not a considerable improvement in source localization accuracy given that, for clinical purposes, ECoG electrodes were implanted in close proximity to the depth electrodes. Furthermore, the ECoG grid attenuates the scalp EEG, due to the electrically isolating silastic sheets in which the ECoG electrodes are embedded. Our results on dipole modeling show that the deep source localization accuracy of scalp EEG is comparable to that of ECoG. SIGNIFICANCE STATEMENT: Deep and subcortical regions play an important role in brain function. However, as joint recordings at multiple spatial scales to study brain function in humans are still scarce, it is still unresolved to what extent ECoG and EEG differ in their capability to locate sources of deep brain activity. To the best of our knowledge, this is the first study presenting a dataset of simultaneously recorded EEG, ECoG and depth electrodes in the hippocampus or insula, with a focus on non-epileptiform activity (quiet wakefulness). Furthermore, we are the first study to provide experimental findings on the comparison of source localization of deep cortical structures between invasive and non-invasive brain activity measured from the cortical surface.

High-gamma oscillations precede visual steady-state responses: A human electrocorticography study.

The robust steady-state cortical activation elicited by flickering visual stimulation has been exploited by a wide range of scientific studies. As the fundamental neural response inherits the spectral properties of the gazed flickering, the paradigm has been used to chart cortical characteristics and their relation to pathologies. However, despite its widespread adoption, the underlying neural mechanisms are not well understood. Here, we show that the fundamental response is preceded by high-gamma (55-125 Hz) oscillations which are also synchronised to the gazed frequency. Using a subdural recording of the primary and associative visual cortices of one human subject, we demonstrate that the latencies of the high-gamma and fundamental components are highly correlated on a single-trial basis albeit that the latter is consistently delayed by approximately 55 ms. These results corroborate previous reports that top-down feedback projections are involved in the generation of the fundamental response, but, in addition, we show that trial-to-trial variability in fundamental latency is paralleled by a highly similar variability in high-gamma latency. Pathology- or paradigm-induced alterations in steady-state responses could thus originate either from deviating visual gamma responses or from aberrations in the neural feedback mechanism. Experiments designed to tease apart the two processes are expected to provide deeper insights into the studied paradigm.

Differential Impact of Cognitive Impairment in MCI Patients: A Case-Based Report.

Mild cognitive impairment (MCI) traditionally refers to an intermediate stage between healthy individuals and early Alzheimer disease. Evidence shows grey and white matter volume changes and decrease in several executive functions, albeit the relation between cognitive performance and brain volume remains unclear. Here, we discuss 3 individual cases of MCI by investigating their MRI scans and cognitive test performance. We also recruited age-matched healthy older adults serving as gold standard for both grey and white matter volume and cognitive test outcomes. Our results show the impact of cognitive impairment on cognitive test performance and grey and white matter volumes, and the role played by cognitive and brain reserve on mitigating cognitive decline. Furthermore, we add evidence to previous studies by showing an increase in white matter volume compared to healthy controls, in all 3 patients. This pattern of increased white matter volume might help us to better understand the pathological mechanisms underlying MCI which in turn could contribute to future investigations.

Single-Trial EEG Responses Classified Using Latency Features.

Covert attention has been repeatedly shown to impact on EEG responses after single and repeated practice sessions. Machine learning techniques are increasingly adopted to classify single-trial EEG responses thereby primarily relying on amplitude-based features instead of latency-based features. In this study, we investigated changes in EEG response signatures of nine healthy older subjects when performing 10 sessions of covert attention training. We show that, when we trained classifiers to distinguish recorded EEG patterns between the two experimental conditions (a target stimulus is "present" or "not present"), latency-based classifiers outperform the amplitude-based ones and that classification accuracy improved along with behavioral accuracy, providing supportive evidence of brain plasticity.

Overlapping connectivity patterns during semantic processing of abstract and concrete words revealed with multivariate Granger Causality analysis.

. Abstract, unlike concrete, nouns refer to notions beyond our perception. Even though there is no consensus among linguists as to what exactly constitutes a concrete or abstract word, neuroscientists found clear evidence of a "concreteness" effect. This can, for instance, be seen in patients with language impairments due to brain injury or developmental disorder who are capable of perceiving one category better than another. Even though the results are inconclusive, neuroimaging studies on healthy subjects also provide a spatial and temporal account of differences in the processing of abstract versus concrete words. A description of the neural pathways during abstract word reading, the manner in which the connectivity patterns develop over the different stages of lexical and semantic processing compared to that of concrete word processing are still debated. We conducted a high-density EEG study on 24 healthy young volunteers using an implicit categorization task. From this, we obtained high spatio-temporal resolution data and, by means of source reconstruction, reduced the effect of signal mixing observed on scalp level. A multivariate, time-varying and directional method of analyzing connectivity based on the concept of Granger Causality (Partial Directed Coherence) revealed a dynamic network that transfers information from the right superior occipital lobe along the ventral and dorsal streams towards the anterior temporal and orbitofrontal lobes of both hemispheres. Some regions along these pathways appear to be primarily involved in either receiving or sending information. A clear difference in information transfer of abstract and concrete words was observed during the time window of semantic processing, specifically for information transferred towards the left anterior temporal lobe. Further exploratory analysis confirmed a generally stronger connectivity pattern for processing concrete words. We believe our study could guide future research towards a more refined theory of abstract word processing in the brain.

Divergent Research Methods Limit Understanding of Working Memory Training.

Working memory training has been a hot topic over the last decade. Although studies show benefits in trained and untrained tasks as a function of training, there is an ongoing debate on the efficacy of working memory training. There have been numerous meta-analyses put forth to the field, some finding overall broad transfer effects while others do not. However, discussion of this research typically overlooks specific qualities of the training and transfer tasks. As such, there has been next to no discussion in the literature on what training and transfer tasks features are likely to mediate training outcomes. To address this gap, here, we characterized the broad diversity of features employed in N-back training tasks and outcome measures in published working memory training studies. Extant meta-analyses have not taken into account the diversity of methodology at this level, primarily because there are too few studies using common methods to allow for a robust meta-analysis. We suggest that these limitations preclude strong conclusions from published data. In order to advance research on working memory training, and in particular, N-back training, more studies are needed that systematically compare training features and use common outcome measures to assess transfer effects.

Information Transmitted From Bioinspired Neuron-Astrocyte Network Improves Cortical Spiking Network's Pattern Recognition Performance.

We trained two spiking neural networks (SNNs), the cortical spiking network (CSN) and the cortical neuron-astrocyte network (CNAN), using a spike-based unsupervised method, on the MNIST and alpha-digit data sets and achieve an accuracy of 96.1% and 77.35%, respectively. We then connected CNAN to CSN by preserving maximum synchronization between them thanks to the concept of prolate spheroidal wave functions (PSWF). As a result, CSN receives additional information from CNAN without retraining. The important outcome is that CSN reaches 70.57% correct classification rate on capital letters without being trained on them. The overall contribution of transfer is 87.47%. We observed that for CSN the classifying neurons that relate to digits 0-9 of the alpha-digit data set are completely supported by the ones that relate to digits 0-9 of the MNIST data set. This means that CSN recognizes the similarity between the digits of the MNIST and alpha-digit data sets and classifies each digit of both data sets in the same class.

Semantic and perceptual priming activate partially overlapping brain networks as revealed by direct cortical recordings in humans.

Facilitation of object processing in the brain due to a related context (priming) can be influenced by both semantic connections and perceptual similarity. It is thus important to discern these two when evaluating the spatio-temporal dynamics of primed object processing. The repetition-priming paradigm frequently used to study perceptual priming is, however, unable to differentiate between the mentioned priming effects, possibly leading to confounded results. In the current study, we recorded brain signals from the scalp and cerebral convexity of nine patients with refractory epilepsy in response to related and unrelated image-pairs, all of which shared perceptual features while only related ones had a semantic connection. While previous studies employing a repetition-priming paradigm observed largely overlapping networks between semantic and perceptual priming effects, our results suggest that this overlap is only partial (both temporally and spatially). These findings stress the importance of controlling for perceptual features when studying semantic priming.