Brain-machine interface for eye movements.

A number of studies in tetraplegic humans and healthy nonhuman primates (NHPs) have shown that neuronal activity from reach-related cortical areas can be used to predict reach intentions using brain-machine interfaces (BMIs) and therefore assist tetraplegic patients by controlling external devices (e.g., robotic limbs and computer cursors). However, to our knowledge, there have been no studies that have applied BMIs to eye movement areas to decode intended eye movements. In this study, we recorded the activity from populations of neurons from the lateral intraparietal area (LIP), a cortical node in the NHP saccade system. Eye movement plans were predicted in real time using Bayesian inference from small ensembles of LIP neurons without the animal making an eye movement. Learning, defined as an increase in the prediction accuracy, occurred at the level of neuronal ensembles, particularly for difficult predictions. Population learning had two components: an update of the parameters of the BMI based on its history and a change in the responses of individual neurons. These results provide strong evidence that the responses of neuronal ensembles can be shaped with respect to a cost function, here the prediction accuracy of the BMI. Furthermore, eye movement plans could be decoded without the animals emitting any actual eye movements and could be used to control the position of a cursor on a computer screen. These findings show that BMIs for eye movements are promising aids for assisting paralyzed patients.

Performance of a multisensor smart ring to evaluate sleep: in-lab and home-based evaluation of generalized and personalized algorithms.

STUDY OBJECTIVES: Wearable sleep technology has rapidly expanded across the consumer market due to advances in technology and increased interest in personalized sleep assessment to improve health and mental performance. We tested the performance of a novel device, the Happy Ring, alongside other commercial wearables (Actiwatch 2, Fitbit Charge 4, Whoop 3.0, Oura Ring V2), against in-lab polysomnography (PSG) and at-home electroencephalography (EEG)-derived sleep monitoring device, the Dreem 2 Headband. METHODS: Thirty-six healthy adults with no diagnosed sleep disorders and no recent use of medications or substances known to affect sleep patterns were assessed across 77 nights. Subjects participated in a single night of in-lab PSG and two nights of at-home data collection. The Happy Ring includes sensors for skin conductance, movement, heart rate, and skin temperature. The Happy Ring utilized two machine-learning derived scoring algorithms: a "generalized" algorithm that applied broadly to all users, and a "personalized" algorithm that adapted to individual subjects' data. Epoch-by-epoch analyses compared the wearable devices to in-lab PSG and to at-home EEG Headband. RESULTS: Compared to in-lab PSG, the "generalized" and "personalized" algorithms demonstrated good sensitivity (94% and 93%, respectively) and specificity (70% and 83%, respectively). The Happy Personalized model demonstrated a lower bias and more narrow limits of agreement across Bland-Altman measures. CONCLUSION: The Happy Ring performed well at home and in the lab, especially regarding sleep/wake detection. The personalized algorithm demonstrated improved detection accuracy over the generalized approach and other devices, suggesting that adaptable, dynamic algorithms can enhance sleep detection accuracy.

Psychometric Properties of a New Stress-Related Personality Scale: The Virtual Inventory of Behavior and Emotions (VIBE).

BACKGROUND: Personality traits are important factors with regard to the tendency to experience and response to stress. This study introduces and tests a new stress-related personality scale called the Virtual Inventory of Behavior and Emotions (VIBE). METHODS: Two samples totaling 5512 individuals (with 66% between the ages of 18 and 34) completed the VIBE along with other measures of personality, stress, mood, and well-being. RESULTS: Exploratory factor analyses revealed a four-factor structure for the instrument with dimensions labeled: 1) stressed; 2) energetic; 3) social; and 4) disciplined. Confirmatory factor analytic procedures on the final 23-item version showed good psychometric properties and data fit while machine learning analyses demonstrated the VIBE's ability to distinguish between groups with similar patterns of response. Strong convergent validity was suggested through robust correlations between the dimensions of the VIBE and other established rating scales. CONCLUSION: Overall, the data suggest that the VIBE is a promising tool to help advance understanding of the relations between stress, personality, and related constructs.

Predicting oculomotor behaviour from correlated populations of posterior parietal neurons.

Oculomotor function critically depends on how signals representing saccade direction and eye position are combined across neurons in the lateral intraparietal (LIP) area of the posterior parietal cortex. Here we show that populations of parietal neurons exhibit correlated variability, and that using these interneuronal correlations yields oculomotor predictions that are more accurate and also less uncertain. The structure of LIP population responses is therefore essential for reliable read-out of oculomotor behaviour.

Inferring eye position from populations of lateral intraparietal neurons.

Understanding how the brain computes eye position is essential to unraveling high-level visual functions such as eye movement planning, coordinate transformations and stability of spatial awareness. The lateral intraparietal area (LIP) is essential for this process. However, despite decades of research, its contribution to the eye position signal remains controversial. LIP neurons have recently been reported to inaccurately represent eye position during a saccadic eye movement, and to be too slow to support a role in high-level visual functions. We addressed this issue by predicting eye position and saccade direction from the responses of populations of LIP neurons. We found that both signals were accurately predicted before, during and after a saccade. Also, the dynamics of these signals support their contribution to visual functions. These findings provide a principled understanding of the coding of information in populations of neurons within an important node of the cortical network for visual-motor behaviors.DOI: http://dx.doi.org/10.7554/eLife.02813.001.

Decoding the activity of neuronal populations in macaque primary visual cortex.

Visual function depends on the accuracy of signals carried by visual cortical neurons. Combining information across neurons should improve this accuracy because single neuron activity is variable. We examined the reliability of information inferred from populations of simultaneously recorded neurons in macaque primary visual cortex. We considered a decoding framework that computes the likelihood of visual stimuli from a pattern of population activity by linearly combining neuronal responses and tested this framework for orientation estimation and discrimination. We derived a simple parametric decoder assuming neuronal independence and a more sophisticated empirical decoder that learned the structure of the measured neuronal response distributions, including their correlated variability. The empirical decoder used the structure of these response distributions to perform better than its parametric variant, indicating that their structure contains critical information for sensory decoding. These results show how neuronal responses can best be used to inform perceptual decision-making.

Prototype classification: insights from machine learning.

We shed light on the discrimination between patterns belonging to two different classes by casting this decoding problem into a generalized prototype framework. The discrimination process is then separated into two stages: a projection stage that reduces the dimensionality of the data by projecting it on a line and a threshold stage where the distributions of the projected patterns of both classes are separated. For this, we extend the popular mean-of-class prototype classification using algorithms from machine learning that satisfy a set of invariance properties. We report a simple yet general approach to express different types of linear classification algorithms in an identical and easy-to-visualize formal framework using generalized prototypes where these prototypes are used to express the normal vector and offset of the hyperplane. We investigate non-margin classifiers such as the classical prototype classifier, the Fisher classifier, and the relevance vector machine. We then study hard and soft margin classifiers such as the support vector machine and a boosted version of the prototype classifier. Subsequently, we relate mean-of-class prototype classification to other classification algorithms by showing that the prototype classifier is a limit of any soft margin classifier and that boosting a prototype classifier yields the support vector machine. While giving novel insights into classification per se by presenting a common and unified formalism, our generalized prototype framework also provides an efficient visualization and a principled comparison of machine learning classification.

Classification of faces in man and machine.

We attempt to shed light on the algorithms humans use to classify images of human faces according to their gender. For this, a novel methodology combining human psychophysics and machine learning is introduced. We proceed as follows. First, we apply principal component analysis (PCA) on the pixel information of the face stimuli. We then obtain a data set composed of these PCA eigenvectors combined with the subjects' gender estimates of the corresponding stimuli. Second, we model the gender classification process on this data set using a separating hyperplane (SH) between both classes. This SH is computed using algorithms from machine learning: the support vector machine (SVM), the relevance vector machine, the prototype classifier, and the K-means classifier. The classification behavior of humans and machines is then analyzed in three steps. First, the classification errors of humans and machines are compared for the various classifiers, and we also assess how well machines can recreate the subjects' internal decision boundary by studying the training errors of the machines. Second, we study the correlations between the rank-order of the subjects' responses to each stimulus-the gender estimate with its reaction time and confidence rating-and the rank-order of the distance of these stimuli to the SH. Finally, we attempt to compare the metric of the representations used by humans and machines for classification by relating the subjects' gender estimate of each stimulus and the distance of this stimulus to the SH. While we show that the classification error alone is not a sufficient selection criterion between the different algorithms humans might use to classify face stimuli, the distance of these stimuli to the SH is shown to capture essentials of the internal decision space of humans. Furthermore, algorithms such as the prototype classifier using stimuli in the center of the classes are shown to be less adapted to model human classification behavior than algorithms such as the SVM based on stimuli close to the boundary between the classes.