Similarities and disparities between visual analysis and high-resolution electromyography of facial expressions.

Computer vision (CV) is widely used in the investigation of facial expressions. Applications range from psychological evaluation to neurology, to name just two examples. CV for identifying facial expressions may suffer from several shortcomings: CV provides indirect information about muscle activation, it is insensitive to activations that do not involve visible deformations, such as jaw clenching. Moreover, it relies on high-resolution and unobstructed visuals. High density surface electromyography (sEMG) recordings with soft electrode array is an alternative approach which provides direct information about muscle activation, even from freely behaving humans. In this investigation, we compare CV and sEMG analysis of facial muscle activation. We used independent component analysis (ICA) and multiple linear regression (MLR) to quantify the similarity and disparity between the two approaches for posed muscle activations. The comparison reveals similarity in event detection, but discrepancies and inconsistencies in source identification. Specifically, the correspondence between sEMG and action unit (AU)-based analyses, the most widely used basis of CV muscle activation prediction, appears to vary between participants and sessions. We also show a comparison between AU and sEMG data of spontaneous smiles, highlighting the differences between the two approaches. The data presented in this paper suggests that the use of AU-based analysis should consider its limited ability to reliably compare between different sessions and individuals and highlight the advantages of high-resolution sEMG for facial expression analysis.

Lie to my face: An electromyography approach to the study of deceptive behavior.

BACKGROUND: Deception is present in all walks of life, from social interactions to matters of homeland security. Nevertheless, reliable indicators of deceptive behavior in real-life scenarios remain elusive. METHODS: By integrating electrophysiological and communicative approaches, we demonstrate a new and objective detection approach to identify participant-specific indicators of deceptive behavior in an interactive scenario of a two-person deception task. We recorded participants' facial muscle activity using novel dry screen-printed electrode arrays and applied machine-learning algorithms to identify lies based on brief facial responses. RESULTS: With an average accuracy of 73%, we identified two groups of participants: Those who revealed their lies by activating their cheek muscles and those who activated their eyebrows. We found that the participants lied more often with time, with some switching their telltale muscle groups. Moreover, while the automated classifier, reported here, outperformed untrained human detectors, their performance was correlated, suggesting reliance on shared features. CONCLUSIONS: Our findings demonstrate the feasibility of using wearable electrode arrays in detecting human lies in a social setting and set the stage for future research on individual differences in deception expression.

Multi-channel electromyography-based mapping of spontaneous smiles.

OBJECTIVE: Human facial muscle activation underlies highly sophisticated signaling mechanisms that are critically important for healthy physiological function. Accordingly, the necessity to analyze facial muscle activation at high-resolution and in a non-invasive manner is important for the diagnosis and treatment of many medical conditions. However, current clinical examination methods are neither precise nor quantitative. APPROACH: Wearable, multi-channel surface electromyography can provide a solution to this yet unmet challenge. Here, we present the design and testing of a customized surface electromyography electrode array for facial muscle mapping. MAIN RESULTS: Muscle activation maps were derived from repeated voluntary facial muscle activations. A customized independent component analysis algorithm and a clustering algorithm were developed to identify consistent building block activation patterns within and between participants. Finally, focusing on spontaneous smile analysis and relying on the building block mapping, we classified muscle activation sources, revealing a consistent intra-subject activation and an inter-subject variability. SIGNIFICANCE: The herein described approach can be readily used for automated and objective mapping of facial expressions in general and in the assessment of normal and abnormal smiling in particular.

Home monitoring of sleep with a temporary-tattoo EEG, EOG and EMG electrode array: a feasibility study.

OBJECTIVE: Circadian and sleep dysfunction have long been symptomatic hallmarks of a variety of devastating neurodegenerative conditions. The gold standard for sleep monitoring is overnight sleep in a polysomnography (PSG) laboratory. However, this method has several limitations such as availability, cost and being labour-intensive. In recent years there has been a heightened interest in home-based sleep monitoring via wearable sensors. Our objective was to demonstrate the use of printed electrode technology as a novel platform for sleep monitoring. APPROACH: Printed electrode arrays offer exciting opportunities in the realm of wearable electrophysiology. In particular, soft electrodes can conform neatly to the wearer's skin, allowing user convenience and stable recordings. As such, soft skin-adhesive non-gel-based electrodes offer a unique opportunity to combine electroencephalography (EEG), electromyography (EMG), electrooculography (EOG) and facial EMG capabilities to capture neural and motor functions in comfortable non-laboratory settings. In this investigation temporary-tattoo dry electrode system for sleep staging analysis was designed, implemented and tested. MAIN RESULTS: EMG, EOG and EEG were successfully recorded using a wireless system. Stable recordings were achieved both at a hospital environment and a home setting. Sleep monitoring during a 6 h session shows clear differentiation of sleep stages. SIGNIFICANCE: The new system has great potential in monitoring sleep disorders in the home environment. Specifically, it may allow the identification of disorders associated with neurological disorders such as rapid eye movement (REM) sleep behavior disorder.

A Wearable High-Resolution Facial Electromyography for Long Term Recordings in Freely Behaving Humans.

Human facial expressions are a complex capacity, carrying important psychological and neurological information. Facial expressions typically involve the co-activation of several muscles; they vary between individuals, between voluntary versus spontaneous expressions, and depend strongly on personal interpretation. Accordingly, while high-resolution recording of muscle activation in a non-laboratory setting offers exciting opportunities, it remains a major challenge. This paper describes a wearable and non-invasive method for objective mapping of facial muscle activation and demonstrates its application in a natural setting. We focus on muscle activation associated with "enjoyment", "social" and "masked" smiles; three categories with distinct social meanings. We use an innovative, dry, soft electrode array designed specifically for facial surface electromyography recording, a customized independent component analysis algorithm, and a short training procedure to achieve the desired mapping. First, identification of the orbicularis oculi and the levator labii superioris was demonstrated from voluntary expressions. Second, the zygomaticus major was identified from voluntary and spontaneous Duchenne and non-Duchenne smiles. Finally, using a wireless device in an unmodified work environment revealed expressions of diverse emotions in face-to-face interaction. Our high-resolution and crosstalk-free mapping, along with excellent user-convenience, opens new opportunities in gaming, virtual-reality, bio-feedback and objective psychological and neurological assessment.

Electrophysiology Meets Printed Electronics: The Beginning of a Beautiful Friendship.

Electroencephalography (EEG) and surface electromyography (sEMG) are notoriously cumbersome technologies. A typical setup may involve bulky electrodes, dangling wires, and a large amplifier unit. Adapting these technologies to numerous applications has been accordingly fairly limited. Thanks to the availability of printed electronics, it is now possible to effectively simplify these techniques. Elegant electrode arrays with unprecedented performances can be readily produced, eliminating the need to handle multiple electrodes and wires. Specifically, in this Perspective paper, we focus on the advantages of electrodes printed on soft films as manifested in signal transmission at the electrode-skin interface, electrode-skin stability, and user convenience during electrode placement while achieving prolonged use. Customizing electrode array designs and implementing blind source separation methods can also improve recording resolution, reduce variability between individuals and minimize signal cross-talk between nearby electrodes. Finally, we outline several important applications in the field of neuroscience and how each can benefit from the convergence of electrophysiology and printed electronics.

Insignificance of active flow for neural diffusion weighted imaging: A negative result.

PURPOSE: To provide a biophysical basis to estimate the effect of cytoplasmic flow in neurons, and assess their contribution to the drop in the Apparent Diffusion Coefficient (ADC) in a nerve tissue following extreme conditions, such as brain injury and epileptic seizures. METHODS: Three mechanisms are treated using the relevant physics of hydrodynamics and electrostatics: cargo induced streaming, electroosmosis, and membrane swelling. RESULTS: We begin by discussing the lack of experimental evidence on the necessary velocities required to influence the Magnetic Resonance (MR) experiments. This is followed by demonstrating that cargo induced streaming, a widely known phenomenon in plant cells, has a minor effect on the ADC in neurons. Subsequently, we suggest and analyze two additional mechanisms that may induce fluid displacement in neurons, and are related to the electrical activity: electroosmosis and membrane swelling. CONCLUSION: Although these mechanisms may induce interesting fluid displacements, these cannot explain the significant drop in the ADC. We conclude by outlining the criteria that any future mechanism should meet to have an influence on standard diffusion-MR measurements. Magn Reson Med 78:746-753, 2017. © 2016 International Society for Magnetic Resonance in Medicine.

Temporary-tattoo for long-term high fidelity biopotential recordings.

Electromyography is a non-invasive method widely used to map muscle activation. For decades, it was commonly accepted that dry metallic electrodes establish poor electrode-skin contact, making them impractical for skin electromyography applications. Gelled electrodes are therefore the standard in electromyography with their use confined, almost entirely, to laboratory settings. Here we present novel dry electrodes, exhibiting outstanding electromyography recording along with excellent user comfort. The electrodes were realized using screen-printing of carbon ink on a soft support. The conformity of the electrodes helps establish direct contact with the skin, making the use of a gel superfluous. Plasma polymerized 3,4-ethylenedioxythiophene was used to enhance the impedance of the electrodes. Cyclic voltammetry measurements revealed an increase in electrode capacitance by a factor of up to 100 in wet conditions. Impedance measurements show a reduction factor of 10 in electrode impedance on human skin. The suitability of the electrodes for long-term electromyography recordings from the hand and from the face is demonstrated. The presented electrodes are ideally-suited for many applications, such as brain-machine interfacing, muscle diagnostics, post-injury rehabilitation, and gaming.

Parkinson disease (PARK) genes are somatically mutated in cutaneous melanoma.

OBJECTIVE: To assess whether Parkinson disease (PD) genes are somatically mutated in cutaneous melanoma (CM) tissue, because CM occurs in patients with PD at higher rates than in the general population and PD is more common than expected in CM cohorts. METHODS: We cross-referenced somatic mutations in metastatic CM detected by whole-exome sequencing with the 15 known PD (PARK) genes. We computed the empirical distribution of the sum of mutations in each gene (Smut) and of the number of tissue samples in which a given gene was mutated at least once (SSampl) for each of the analyzable genes, determined the 90th and 95th percentiles of the empirical distributions of these sums, and verified the location of PARK genes in these distributions. Identical analyses were applied to adenocarcinoma of lung (ADENOCA-LUNG) and squamous cell carcinoma of lung (SQUAMCA-LUNG). We also analyzed the distribution of the number of mutated PARK genes in CM samples vs the 2 lung cancers. RESULTS: Somatic CM mutation analysis (n = 246) detected 315,914 mutations in 18,758 genes. Somatic CM mutations were found in 14 of 15 PARK genes. Forty-eight percent of CM samples carried ≥1 PARK mutation and 25% carried multiple PARK mutations. PARK8 mutations occurred above the 95th percentile of the empirical distribution for SMut and SSampl. Significantly more CM samples harbored multiple PARK gene mutations compared with SQUAMCA-LUNG (p = 0.0026) and with ADENOCA-LUNG (p < 0.0001). CONCLUSIONS: The overrepresentation of somatic PARK mutations in CM suggests shared dysregulated pathways for CM and PD.