Brain-Computer Interfaces for Communication in Patients with Disorders of Consciousness: A Gap Analysis and Scientific Roadmap.

BACKGROUND: We developed a gap analysis that examines the role of brain-computer interfaces (BCI) in patients with disorders of consciousness (DoC), focusing on their assessment, establishment of communication, and engagement with their environment. METHODS: The Curing Coma Campaign convened a Coma Science work group that included 16 clinicians and neuroscientists with expertise in DoC. The work group met online biweekly and performed a gap analysis of the primary question. RESULTS: We outline a roadmap for assessing BCI readiness in patients with DoC and for advancing the use of BCI devices in patients with DoC. Additionally, we discuss preliminary studies that inform development of BCI solutions for communication and assessment of readiness for use of BCIs in DoC study participants. Special emphasis is placed on the challenges posed by the complex pathophysiologies caused by heterogeneous brain injuries and their impact on neuronal signaling. The differences between one-way and two-way communication are specifically considered. Possible implanted and noninvasive BCI solutions for acute and chronic DoC in adult and pediatric populations are also addressed. CONCLUSIONS: We identify clinical and technical gaps hindering the use of BCI in patients with DoC in each of these contexts and provide a roadmap for research aimed at improving communication for adults and children with DoC, spanning the clinical spectrum from intensive care unit to chronic care.

Methods for automated delineation and assessment of EMG responses evoked by peripheral nerve stimulation in diagnostic and closed-loop therapeutic applications.

Objective.Surface electromyography measurements of the Hoffmann (H-) reflex are essential in a wide range of neuroscientific and clinical applications. One promising emerging therapeutic application is H-reflex operant conditioning, whereby a person is trained to modulate the H-reflex, with generalized beneficial effects on sensorimotor function in chronic neuromuscular disorders. Both traditional diagnostic and novel realtime therapeutic applications rely on accurate definitions of the H-reflex and M-wave temporal bounds, which currently depend on expert case-by-case judgment. The current study automates such judgments.Approach.Our novel wavelet-based algorithm automatically determines temporal extent and amplitude of the human soleus H-reflex and M-wave. In each of 20 participants, the algorithm was trained on data from a preliminary 3 or 4 min recruitment-curve measurement. Output was evaluated on parametric fits to subsequent sessions' recruitment curves (92 curves across all participants) and on the conditioning protocol's subsequent baseline trials (∼1200 per participant) performed nearHmax. Results were compared against the original temporal bounds estimated at the time, and against retrospective estimates made by an expert 6 years later.Main results.Automatic bounds agreed well with manual estimates: 95% lay within ±2.5 ms. The resulting H-reflex magnitude estimates showed excellent agreement (97.5% average across participants) between automatic and retrospective bounds regarding which trials would be considered successful for operant conditioning. Recruitment-curve parameters also agreed well between automatic and manual methods: 95% of the automatic estimates of the current required to elicitHmaxfell within±1.4%of the retrospective estimate; for the 'threshold' current that produced an M-wave 10% of maximum, this value was±3.5%.Significance.Such dependable automation of M-wave and H-reflex definition should make both established and emerging H-reflex protocols considerably less vulnerable to inter-personnel variability and human error, increasing translational potential.

Comparisons of electrophysiological markers of impaired executive attention after traumatic brain injury and in healthy aging.

Executive attention impairments are a persistent and debilitating consequence of traumatic brain injury (TBI). To make headway towards treating and predicting outcomes following heterogeneous TBI, cognitive impairment specific pathophysiology first needs to be characterized. In a prospective observational study, we measured EEG during the attention network test aimed at detecting alerting, orienting, executive attention and processing speed. The sample (N = 110) of subjects aged 18-86 included those with and without traumatic brain injury: n = 27, complicated mild TBI; n = 5, moderate TBI; n = 10, severe TBI; n = 63, non-brain-injured controls. Subjects with TBI had impairments in processing speed and executive attention. Electrophysiological markers of executive attention processing in the midline frontal regions reveal that, as a group, those with TBI and elderly non-brain-injured controls have reduced responses. We also note that those with TBI and elderly controls have responses that are similar for both low and high-demand trials. In subjects with moderate-severe TBI, reductions in frontal cortical activation and performance profiles are both similar to that of controls who are ∼4 to 7 years older. Our specific observations of frontal response reductions in subjects with TBI and in older adults is consistent with the suggested role of the anterior forebrain mesocircuit as underlying cognitive impairments. Our results provide novel correlative data linking specific pathophysiological mechanisms underlying domain-specific cognitive deficits following TBI and with normal aging. Collectively, our findings provide biomarkers that may serve to track therapeutic interventions and guide development of targeted therapeutics following brain injuries.

Objective Neurophysiologic Markers of Cognition After Pediatric Brain Injury.

Background and Objectives: Following brain injury, clinical assessments of residual and emerging cognitive function are difficult and fraught with errors. In adults, recent American Academy of Neurology (AAN) practice guidelines recommend objective neuroimaging and neurophysiologic measures to support diagnosis. Equivalent measures are lacking in pediatrics-an especially great challenge due to the combined heterogeneity of both brain injury and pediatric development. Therefore, we aim to establish quantitative, clinically practicable measures of cognitive function following pediatric brain injury. Methods: Participants with and without brain injury were aged 8-18 years, clinically classified according to cognitive recovery state: N = 8 in disorders of consciousness (DoC), N = 7 in confusional state, N = 19 cognitively impaired, and N = 13 typically developing uninjured controls. We prospectively measured electroencephalographic markers of sensory processing and attention in an auditory oddball paradigm, and of covert movement attempts in a command-following paradigm. Results: In 3 participants with DoC, EEG markers of active attempted command following revealed cognitive function that clinical assessment had failed to detect. These same 3 individuals could also be distinguished from the rest of their group by 2 event-related potentials that correlate with sensory processing and orienting attention in the oddball paradigm. Considered across the whole participant group, magnitudes of these 2 ERP markers significantly increased as cognitive recovery progressed (ANOVA: each p < 0.001); viewed jointly, the 2 ERP markers cleanly delineated the 4 cognitive states. Discussion: Despite heterogeneity of brain injuries and brain development, our objective EEG markers reflected cognitive recovery independent of motor function. Two of these markers required no active participation. Together, they allowed us to identify 3 individuals who meet the criteria for cognitive-motor dissociation. To diagnose, prognose, and track cognitive recovery accurately, such markers should be used in pediatrics.

The Evoked Potential Operant Conditioning System (EPOCS): A Research Tool and an Emerging Therapy for Chronic Neuromuscular Disorders.

The Evoked Potential Operant Conditioning System (EPOCS) is a software tool that implements protocols for operantly conditioning stimulus-triggered muscle responses in people with neuromuscular disorders, which in turn can improve sensorimotor function when applied appropriately. EPOCS monitors the state of specific target muscles-e.g., from surface electromyography (EMG) while standing, or from gait cycle measurements while walking on a treadmill-and automatically triggers calibrated stimulation when pre-defined conditions are met. It provides two forms of feedback that enable a person to learn to modulate the targeted pathway's excitability. First, it continuously monitors ongoing EMG activity in the target muscle, guiding the person to produce a consistent level of activity suitable for conditioning. Second, it provides immediate feedback of the response size following each stimulation and indicates whether it has reached the target value. To illustrate its use, this article describes a protocol through which a person can learn to decrease the size of the Hoffmann reflex-the electrically-elicited analog of the spinal stretch reflex-in the soleus muscle. Down-conditioning this pathway's excitability can improve walking in people with spastic gait due to incomplete spinal cord injury. The article demonstrates how to set up the equipment; how to place stimulating and recording electrodes; and how to use the free software to optimize electrode placement, measure the recruitment curve of direct motor and reflex responses, measure the response without operant conditioning, condition the reflex, and analyze the resulting data. It illustrates how the reflex changes over multiple sessions and how walking improves. It also discusses how the system can be applied to other kinds of evoked responses and to other kinds of stimulation, e.g., motor evoked potentials to transcranial magnetic stimulation; how it can address various clinical problems; and how it can support research studies of sensorimotor function in health and disease.

Cognitive-Motor Dissociation Following Pediatric Brain Injury: What About the Children?

Background and Objectives: Following severe brain injury, up to 16% of adults showing no clinical signs of cognitive function nonetheless have preserved cognitive capacities detectable via neuroimaging and neurophysiology; this has been designated cognitive-motor dissociation (CMD). Pediatric medicine lacks both practice guidelines for identifying covert cognition and epidemiologic data regarding CMD prevalence. Methods: We applied a diverse battery of neuroimaging and neurophysiologic tests to evaluate 2 adolescents (aged 15 and 18 years) who had shown no clinical evidence of preserved cognitive function following brain injury at age 9 and 13 years, respectively. Clinical evaluations were consistent with minimally conscious state (minus) and vegetative state, respectively. Results: Both participants' EEG, and 1 participant's fMRI, provided evidence that they could understand commands and make consistent voluntary decisions to follow them. Both participants' EEG demonstrated larger-than-expected responses to auditory stimuli and intact semantic processing of words in context. Discussion: These converging lines of evidence lead us to conclude that both participants had preserved cognitive function dissociated from their motor output. Throughout the 5+ years since injury, communication attempts and therapy had remained uninformed by such objective evidence of their cognitive abilities. Proper diagnosis of CMD is an ethical imperative. Children with covert cognition reflect a vulnerable and isolated population; the methods outlined here provide a first step in identifying such persons to advance efforts to alleviate their condition.

audiomath: A neuroscientist's sound toolkit.

In neuroscientific experiments and applications, working with auditory stimuli demands software tools for generation and acquisition of raw audio, for composition and tailoring of that material into finished stimuli, for precisely timed presentation of the stimuli, and for experimental session recording. Numerous programming tools exist to approach these tasks, but their differing specializations and conventions demand extra time and effort for integration. In particular, verifying stimulus timing requires extensive engineering effort when developing new applications. This paper has two purposes. The first is to present audiomath (https://pypi.org/project/audiomath), a sound software library for Python that prioritizes the needs of neuroscientists. It minimizes programming effort by providing a simple object-oriented interface that unifies functionality for audio generation, manipulation, visualization, decoding, encoding, recording, and playback. It also incorporates specialized tools for measuring and optimizing stimulus timing. The second purpose is to relay what we have learned, during development and application of the software, about the twin challenges of delivering stimuli precisely at a certain time, and of precisely measuring the time at which stimuli were delivered. We provide a primer on these problems and the possible approaches to them. We then report audio latency measurements across a range of hardware, operating systems and settings, to illustrate the ways in which hardware and software factors interact to affect stimulus presentation performance, and the resulting pitfalls for the programmer and experimenter. In particular, we highlight the potential conflict between demands for low latency, low variability in latency ("jitter"), cooperativeness, and robustness. We report the ways in which audiomath can help to map this territory and provide a simplified path toward each application's particular priority. By unifying audio-related functionality and providing specialized diagnostic tools, audiomath both simplifies and potentiates the development of neuroscientific applications in Python.

Gradiate: A radial sweep approach to measuring detailed contrast sensitivity functions from eye movements.

The contrast sensitivity function (CSF) is an informative measure of visual health, but the practical difficulty of measuring it has impeded detailed analyses of its relationship to different visual disorders. Furthermore, most existing tasks cannot be used in populations with cognitive impairment. We analyzed detailed CSFs measured with a nonverbal procedure called "Gradiate," which efficiently infers visibility from eye movements and manipulates stimulus appearance in real time. Sixty observers of varying age (38 with refractive error) were presented with moving stimuli. Stimulus spatial frequency and contrast advanced along 15 radial sweeps through CSF space in response to stimulus-congruent eye movements. A point on the CSF was recorded when tracking ceased. Gradiate CSFs were reliable and in high agreement with independent low-contrast acuity thresholds. Overall CSF variation was largely captured by two orthogonal factors ("radius" and "slope") or two orthogonal shape factors when size was normalized ("aspect ratio" and "curvature"). CSF radius was highly predictive of LogMAR acuity, as were aspect ratio and curvature together, but only radius was predictive of observer age. Our findings suggest that Gradiate holds promise for assessing spatial vision in both verbal and nonverbal populations and indicate that variation between detailed CSFs can reveal useful information about visual health.

Motometrics: A Toolbox for Annotation and Efficient Analysis of Motor Evoked Potentials.

Stimulating the nervous system and measuring muscle response offers a unique opportunity to interrogate motor system function. Often, this is performed by stimulating motor cortex and recording muscle activity with electromyography; the evoked response is called the motor evoked potential (MEP). To understand system dynamics, MEPs are typically recorded through a range of motor cortex stimulation intensities. The MEPs increase with increasing stimulation intensities, and these typically produce a sigmoidal response curve. Analysis of MEPs is often complex and analysis of response curves is time-consuming. We created an MEP analysis software, called Motometrics, to facilitate analysis of MEPs and response curves. The goal is to combine robust signal processing algorithms with a simple user interface. Motometrics first enables the user to annotate data files acquired from the recording system so that the responses can be extracted and labeled with the correct subject and experimental condition. The software enables quick visual representations of entire datasets, to ensure uniform quality of the signal. It then enables the user to choose a variety of response curve analyses and to perform near real time quantification of the MEPs for quick feedback during experimental procedures. This is a modular open source tool that is compatible with several popular electrophysiological systems. Initial use indicates that Motometrics enables rapid, robust, and intuitive analysis of MEP response curves by neuroscientists without programming or signal processing expertise.

Shady: A software engine for real-time visual stimulus manipulation.

BACKGROUND: Precise definition, rendering and manipulation of visual stimuli are essential in neuroscience. Rather than implementing these tasks from scratch, scientists benefit greatly from using reusable software routines from freely available toolboxes. Existing toolboxes work well when the operating system and hardware are painstakingly optimized, but may be less suited to applications that require multi-tasking (for example, closed-loop systems that involve real-time acquisition and processing of signals). NEW METHOD: We introduce a new cross-platform visual stimulus toolbox called Shady (https://pypi.org/project/Shady)-so called because of its heavy reliance on a shader program to perform parallel pixel processing on a computer's graphics processor. It was designed with an emphasis on performance robustness in multi-tasking applications under unforgiving conditions. For optimal timing performance, the CPU drawing management commands are carried out by a compiled binary engine. For configuring stimuli and controlling their changes over time, Shady provides a programmer's interface in Python, a powerful, accessible and widely-used high-level programming language. RESULTS: Our timing benchmark results illustrate that Shady's hybrid compiled/interpreted architecture requires less time to complete drawing operations, exhibits smaller variability in frame-to-frame timing, and hence drops fewer frames, than pure-Python solutions under matched conditions of resource contention. This performance gain comes despite an expansion of functionality (e.g. "noisy-bit" dithering as standard on all pixels and all frames, to enhance effective dynamic range) relative to previous offerings. CONCLUSIONS: Shady simultaneously advances the functionality and performance available to scientists for rendering visual stimuli and manipulating them in real time.

Curveball: A tool for rapid measurement of contrast sensitivity based on smooth eye movements.

The contrast sensitivity function (CSF) is an informative measure of visual function, but current tools for assessing it are limited by the attentional, motor, and communicative abilities of the participant. Impairments in these abilities can prevent participants from engaging with tasks or following an experimenter's instructions. Here, we describe an efficient new tool for measuring contrast sensitivity, Curveball, and empirically validate it with a sample of healthy adults. The Curveball algorithm continuously infers stimulus visibility through smooth eye tracking instead of perceptual report, and rapidly lowers stimulus contrast in real time until a threshold is found. The procedure requires minimal instruction to administer and takes only five minutes to estimate a full CSF, which is comparable to the best existing methods available for healthy adults. Task repeatability was high: the coefficients of repeatability were 0.275 (in log10 units of RMS contrast) within the same session and 0.227 across different days. We also present evidence that the task is robust across illumination changes, well correlated with results from conventional psychophysical methods, and highly sensitive to improvements in visual acuity from refractive correction. Our findings indicate that Curveball is a promising means of accurately assessing contrast sensitivity in previously neglected populations.

Corrigendum: Plasticity in One Hemisphere, Control From Two: Adaptation in Descending Motor Pathways After Unilateral Corticospinal Injury in Neonatal Rats.

[This corrects the article DOI: 10.3389/fncir.2018.00028.].

Effects of Sensorimotor Rhythm Modulation on the Human Flexor Carpi Radialis H-Reflex.

People can learn over training sessions to increase or decrease sensorimotor rhythms (SMRs) in the electroencephalogram (EEG). Activity-dependent brain plasticity is thought to guide spinal plasticity during motor skill learning; thus, SMR training may affect spinal reflexes and thereby influence motor control. To test this hypothesis, we investigated the effects of learned mu (8-13 Hz) SMR modulation on the flexor carpi radialis (FCR) H-reflex in 6 subjects with no known neurological conditions and 2 subjects with chronic incomplete spinal cord injury (SCI). All subjects had learned and practiced over more than 10 < 30-min training sessions to increase (SMR-up trials) and decrease (SMR-down trials) mu-rhythm amplitude over the hand/arm area of left sensorimotor cortex with ≥80% accuracy. Right FCR H-reflexes were elicited at random times during SMR-up and SMR-down trials, and in between trials. SMR modulation affected H-reflex size. In all the neurologically normal subjects, the H-reflex was significantly larger [116% ± 6 (mean ± SE)] during SMR-up trials than between trials, and significantly smaller (92% ± 1) during SMR-down trials than between trials (p < 0.05 for both, paired t-test). One subject with SCI showed similar H-reflex size dependence (high for SMR-up trials, low for SMR-down trials): the other subject with SCI showed no dependence. These results support the hypothesis that SMR modulation has predictable effects on spinal reflex excitability in people who are neurologically normal; they also suggest that it might be used to enhance therapies that seek to improve functional recovery in some individuals with SCI or other CNS disorders.

Plasticity in One Hemisphere, Control From Two: Adaptation in Descending Motor Pathways After Unilateral Corticospinal Injury in Neonatal Rats.

After injury to the corticospinal tract (CST) in early development there is large-scale adaptation of descending motor pathways. Some studies suggest the uninjured hemisphere controls the impaired forelimb, while others suggest that the injured hemisphere does; these pathways have never been compared directly. We tested the contribution of each motor cortex to the recovery forelimb function after neonatal injury of the CST. We cut the left pyramid (pyramidotomy) of postnatal day 7 rats, which caused a measurable impairment of the right forelimb. We used pharmacological inactivation of each motor cortex to test its contribution to a skilled reach and supination task. Rats with neonatal pyramidotomy were further impaired by inactivation of motor cortex in both the injured and the uninjured hemispheres, while the forelimb of uninjured rats was impaired only from the contralateral motor cortex. Thus, inactivation demonstrated motor control from each motor cortex. In contrast, physiological and anatomical interrogation of these pathways support adaptations only in the uninjured hemisphere. Intracortical microstimulation of motor cortex in the uninjured hemisphere of rats with neonatal pyramidotomy produced responses from both forelimbs, while stimulation of the injured hemisphere did not elicit responses from either forelimb. Both anterograde and retrograde tracers were used to label corticofugal pathways. There was no increased plasticity from the injured hemisphere, either from cortex to the red nucleus or the red nucleus to the spinal cord. In contrast, there were very strong CST connections to both halves of the spinal cord from the uninjured motor cortex. Retrograde tracing produced maps of each forelimb within the uninjured hemisphere, and these were partly segregated. This suggests that the uninjured hemisphere may encode separate control of the unimpaired and the impaired forelimbs of rats with neonatal pyramidotomy.

Longitudinal Quantification of Eye-Movement Impairments after Pontine Hemorrhage.

INTRODUCTION: We report a case of hypertrophic olivary degeneration due to pontine hemorrhage. A 59-year-old male with untreated hypertension suffered a primary pontine hemorrhage, which caused horizontal eye-movement limitation. Progressive neurological deterioration with involuntary eye and palatal movements began months after hemorrhage. This was accompanied by magnetic resonance imaging evidence of hypertrophic olivary degeneration at 4.5 months. BACKGROUND: Primary pontine hemorrhage often leads to impairment of eye movements and diplopia. Hypertrophic olivary degeneration can also emerge months after hemorrhage, producing involuntary pendular eye movements. Neither the natural history of voluntary eye movements nor the emergence of involuntary eye movements after pontine hemorrhage has been previously quantified. METHODS: We used an optokinetic task that enabled measurement of eye movements. It provided real-time feedback on the ability to track continuously and saccade quickly in a pursuit task. The feedback motivated the patient to use the system repeatedly in his home. From 3 months after hemorrhage, the patient used the system for 9 months, allowing us to quantify changes in his eye movements. RESULTS: Horizontal gaze impairments were manifest in our task as limitation in horizontal range of motion, as well as delay in initiation of the right eye's movement during left-to-right pursuit. Improvement in these impairments was measured over the course of months 3-7 post hemorrhage. In addition, the emergence of vertical pendular nystagmus was identified in the subject at 4 months. Analysis of the eye-movement records revealed presymptomatic oscillatory eye movements whose amplitude had grown steadily over the course of 3 weeks, prior to a sharp increase in amplitude that coincided with the patient's first report of oscillopsia. Horizontal pendular nystagmus emerged 7.4 months after the hemorrhage, primarily in the left eye. CONCLUSION: An eye-tracking system deployed in a patient's home enabled prospective longitudinal quantification of the natural history and improvement in voluntary eye-movement impairments after pontine hemorrhage. It also characterized prospectively for the first time, the emergence of involuntary eye movements resulting from the rare complication of hypertrophic olivary degeneration. Results suggest that brief weekly measurements with an eye-tracker may allow early detection of this complication.

Validation of the Leap Motion Controller using markered motion capture technology.

The Leap Motion Controller (LMC) is a low-cost, markerless motion capture device that tracks hand, wrist and forearm position. Integration of this technology into healthcare applications has begun to occur rapidly, making validation of the LMC׳s data output an important research goal. Here, we perform a detailed evaluation of the kinematic data output from the LMC, and validate this output against gold-standard, markered motion capture technology. We instructed subjects to perform three clinically-relevant wrist (flexion/extension, radial/ulnar deviation) and forearm (pronation/supination) movements. The movements were simultaneously tracked using both the LMC and a marker-based motion capture system from Motion Analysis Corporation (MAC). Adjusting for known inconsistencies in the LMC sampling frequency, we compared simultaneously acquired LMC and MAC data by performing Pearson׳s correlation (r) and root mean square error (RMSE). Wrist flexion/extension and radial/ulnar deviation showed good overall agreement (r=0.95; RMSE=11.6°, and r=0.92; RMSE=12.4°, respectively) with the MAC system. However, when tracking forearm pronation/supination, there were serious inconsistencies in reported joint angles (r=0.79; RMSE=38.4°). Hand posture significantly influenced the quality of wrist deviation (P<0.005) and forearm supination/pronation (P<0.001), but not wrist flexion/extension (P=0.29). We conclude that the LMC is capable of providing data that are clinically meaningful for wrist flexion/extension, and perhaps wrist deviation. It cannot yet return clinically meaningful data for measuring forearm pronation/supination. Future studies should continue to validate the LMC as updated versions of their software are developed.

Cortical alpha activity predicts the confidence in an impending action.

When we make a decision, we experience a degree of confidence that our choice may lead to a desirable outcome. Recent studies in animals have probed the subjective aspects of the choice confidence using confidence-reporting tasks. These studies showed that estimates of the choice confidence substantially modulate neural activity in multiple regions of the brain. Building on these findings, we investigated the neural representation of the confidence in a choice in humans who explicitly reported the confidence in their choice. Subjects performed a perceptual decision task in which they decided between choosing a button press or a saccade while we recorded EEG activity. Following each choice, subjects indicated whether they were sure or unsure about the choice. We found that alpha activity strongly encodes a subject's confidence level in a forthcoming button press choice. The neural effect of the subjects' confidence was independent of the reaction time and independent of the sensory input modeled as a decision variable. Furthermore, the effect is not due to a general cognitive state, such as reward expectation, because the effect was specifically observed during button press choices and not during saccade choices. The neural effect of the confidence in the ensuing button press choice was strong enough that we could predict, from independent single trial neural signals, whether a subject was going to be sure or unsure of an ensuing button press choice. In sum, alpha activity in human cortex provides a window into the commitment to make a hand movement.

Localizing ECoG electrodes on the cortical anatomy without post-implantation imaging.

INTRODUCTION: Electrocorticographic (ECoG) grids are placed subdurally on the cortex in people undergoing cortical resection to delineate eloquent cortex. ECoG signals have high spatial and temporal resolution and thus can be valuable for neuroscientific research. The value of these data is highest when they can be related to the cortical anatomy. Existing methods that establish this relationship rely either on post-implantation imaging using computed tomography (CT), magnetic resonance imaging (MRI) or X-Rays, or on intra-operative photographs. For research purposes, it is desirable to localize ECoG electrodes on the brain anatomy even when post-operative imaging is not available or when intra-operative photographs do not readily identify anatomical landmarks. METHODS: We developed a method to co-register ECoG electrodes to the underlying cortical anatomy using only a pre-operative MRI, a clinical neuronavigation device (such as BrainLab VectorVision), and fiducial markers. To validate our technique, we compared our results to data collected from six subjects who also had post-grid implantation imaging available. We compared the electrode coordinates obtained by our fiducial-based method to those obtained using existing methods, which are based on co-registering pre- and post-grid implantation images. RESULTS: Our fiducial-based method agreed with the MRI-CT method to within an average of 8.24 mm (mean, median = 7.10 mm) across 6 subjects in 3 dimensions. It showed an average discrepancy of 2.7 mm when compared to the results of the intra-operative photograph method in a 2D coordinate system. As this method does not require post-operative imaging such as CTs, our technique should prove useful for research in intra-operative single-stage surgery scenarios. To demonstrate the use of our method, we applied our method during real-time mapping of eloquent cortex during a single-stage surgery. The results demonstrated that our method can be applied intra-operatively in the absence of post-operative imaging to acquire ECoG signals that can be valuable for neuroscientific investigations.

A practical, intuitive brain-computer interface for communicating 'yes' or 'no' by listening.

OBJECTIVE: Previous work has shown that it is possible to build an EEG-based binary brain-computer interface system (BCI) driven purely by shifts of attention to auditory stimuli. However, previous studies used abrupt, abstract stimuli that are often perceived as harsh and unpleasant, and whose lack of inherent meaning may make the interface unintuitive and difficult for beginners. We aimed to establish whether we could transition to a system based on more natural, intuitive stimuli (spoken words 'yes' and 'no') without loss of performance, and whether the system could be used by people in the locked-in state. APPROACH: We performed a counterbalanced, interleaved within-subject comparison between an auditory streaming BCI that used beep stimuli, and one that used word stimuli. Fourteen healthy volunteers performed two sessions each, on separate days. We also collected preliminary data from two subjects with advanced amyotrophic lateral sclerosis (ALS), who used the word-based system to answer a set of simple yes-no questions. MAIN RESULTS: The N1, N2 and P3 event-related potentials elicited by words varied more between subjects than those elicited by beeps. However, the difference between responses to attended and unattended stimuli was more consistent with words than beeps. Healthy subjects' performance with word stimuli (mean 77% ± 3.3 s.e.) was slightly but not significantly better than their performance with beep stimuli (mean 73% ± 2.8 s.e.). The two subjects with ALS used the word-based BCI to answer questions with a level of accuracy similar to that of the healthy subjects. SIGNIFICANCE: Since performance using word stimuli was at least as good as performance using beeps, we recommend that auditory streaming BCI systems be built with word stimuli to make the system more pleasant and intuitive. Our preliminary data show that word-based streaming BCI is a promising tool for communication by people who are locked in.

A general method for assessing brain-computer interface performance and its limitations.

OBJECTIVE: When researchers evaluate brain-computer interface (BCI) systems, we want quantitative answers to questions such as: How good is the system's performance? How good does it need to be? and: Is it capable of reaching the desired level in future? In response to the current lack of objective, quantitative, study-independent approaches, we introduce methods that help to address such questions. We identified three challenges: (I) the need for efficient measurement techniques that adapt rapidly and reliably to capture a wide range of performance levels; (II) the need to express results in a way that allows comparison between similar but non-identical tasks; (III) the need to measure the extent to which certain components of a BCI system (e.g. the signal processing pipeline) not only support BCI performance, but also potentially restrict the maximum level it can reach. APPROACH: For challenge (I), we developed an automatic staircase method that adjusted task difficulty adaptively along a single abstract axis. For challenge (II), we used the rate of information gain between two Bernoulli distributions: one reflecting the observed success rate, the other reflecting chance performance estimated by a matched random-walk method. This measure includes Wolpaw's information transfer rate as a special case, but addresses the latter's limitations including its restriction to item-selection tasks. To validate our approach and address challenge (III), we compared four healthy subjects' performance using an EEG-based BCI, a 'Direct Controller' (a high-performance hardware input device), and a 'Pseudo-BCI Controller' (the same input device, but with control signals processed by the BCI signal processing pipeline). MAIN RESULTS: Our results confirm the repeatability and validity of our measures, and indicate that our BCI signal processing pipeline reduced attainable performance by about 33% (21 bits min(-1)). SIGNIFICANCE: Our approach provides a flexible basis for evaluating BCI performance and its limitations, across a wide range of tasks and task difficulties.