Similarities and disparities between visual analysis and high-resolution electromyography of facial expressions.

Computer vision (CV) is widely used in the investigation of facial expressions. Applications range from psychological evaluation to neurology, to name just two examples. CV for identifying facial expressions may suffer from several shortcomings: CV provides indirect information about muscle activation, it is insensitive to activations that do not involve visible deformations, such as jaw clenching. Moreover, it relies on high-resolution and unobstructed visuals. High density surface electromyography (sEMG) recordings with soft electrode array is an alternative approach which provides direct information about muscle activation, even from freely behaving humans. In this investigation, we compare CV and sEMG analysis of facial muscle activation. We used independent component analysis (ICA) and multiple linear regression (MLR) to quantify the similarity and disparity between the two approaches for posed muscle activations. The comparison reveals similarity in event detection, but discrepancies and inconsistencies in source identification. Specifically, the correspondence between sEMG and action unit (AU)-based analyses, the most widely used basis of CV muscle activation prediction, appears to vary between participants and sessions. We also show a comparison between AU and sEMG data of spontaneous smiles, highlighting the differences between the two approaches. The data presented in this paper suggests that the use of AU-based analysis should consider its limited ability to reliably compare between different sessions and individuals and highlight the advantages of high-resolution sEMG for facial expression analysis.

Regenerative application of stromal vascular fraction cells enhanced fat graft maintenance: clinical assessment in face rejuvenation.

OBJECTIVES: The aim of this study was to evaluate the safety and efficacy of the use of FG-SVFs in face rejuvenation for esthetic improvement. METHODS: 33 female patients affected by face's soft-tissue defects with loss of volume, study group (SG), were treated with FG-SVFs, comparing results with a control group (CG) (n = 30) treated with fat graft not enhanced (FG). Clinical evaluation, a photographic assessment, magnetic resonance imaging (MRI), and ultrasound (US) were performed. Post-operative follow-up was performed at 1, 3, 7, 12, 24, 48, weeks, and then annually. RESULTS: SG patients showed 61% maintenance of the contour restoring and of volume after 3 years compared with the CG treated with FG, who showed 31% maintenance. 60.7% (n = 20) of SG patients, presented an increase of 6.6 mm in the soft tissue volume after 36 months, which was reported in only 33,3% (n = 10) of the CG. Volumetric persistence in the SG was higher than that in the CG (p <. 0001 vs. CG). MRI and US moreover confirmed the absence of important side effects, as fat necrosis, and cytosteatonecrotic areas. CONCLUSIONS: The use of FG-SVFs was safe and effective in this series of a case treated.

Depiction of ethnic facial aging by forensic artists and preliminary assessment of the applicability of facial averages.

Many characteristics of facial aging are common to all. The age of their onset and which characteristics tend to predominate varies among individuals depending on many factors including their genetic makeup, life experiences, environment in which they live, and the regional, ethnic, or socially perceived group to which they belong. Forensic artists are often asked to provide sketches, 2D or 3D digital renderings, or sculptures representative of how an individual may appear at an older age based on a provided photograph, victim or witness description, and/or cranial remains. The challenge escalates when the subject is a member of a regional, ethnic, or other socially perceived group to which the artist has had little or no exposure. We describe aspects of adult facial aging that are of particular relevance to the forensic artist, applicable software tools, and pertinent facial databases, especially those emphasizing non-white populations. We demonstrate that facial averaging offers two key advantages to the artistic portrayal of facial aging: first, the technique requires relatively small reference databases from groups that may present logistical challenges to collect and second, that a facial average provides a useful representation of the gestalt of the age and ethnicity cohort to which a subject belongs. The artist may use an average along with other available information such as photo reference books, eyewitness descriptions, photos of immediate family members, and cranial structure to guide production of a facial composite drawing, digital age progression, or sculpture of the subject in question.

Minimally Invasive Facial Cosmetic Procedures for the Millennial Aesthetic Patient.

Millennials, defined as the generation of individuals born between 1981 and 1996, have emerged as one of the leading patient demographics seeking minimally invasive cosmetic procedures. Worldwide, millennials are more likely to consider preventative treatments compared to any other age-group. The three most popular minimally invasive facial procedures in this demographic include botulinum toxin, dermal fillers (eg, hyaluronic acid, calcium hydroxylapatite, facial fat-fillers), and microdermabrasion. Given their impact on the expanding aesthetic medicine market and their favorable disposition towards cosmetic procedures, it is necessary for dermatologists and cosmetic providers to understand their motivations and perspectives. While some research studies have elicited the opinions of millennials on social issues, education, and technology, there is a paucity of literature on millennials' impressions, opinions, and perceptions of aesthetic procedures. As a generation that has been reshaping the culture of healthcare delivery and encouraging the innovation of products and procedures with their unique values and perspectives, accounting for their beliefs and fostering a better understanding of their experiences will promote an elevation in the quality of their care.

Lengthening of magnetically controlled growing rods caused minimal pain in 25 children: pain assessment with FPS-R, NRS, and r-FLACC.

STUDY DESIGN: Descriptive case series. OBJECTIVE: The aim of the study is to investigate the pain associated with magnetically controlled growing rod (MCGR) lengthening procedures. MCGRs have gained popularity because they offer non-surgical lengthening procedures in early-onset scoliosis (EOS) instead of semi-annual open surgery elongations with traditional growing rods. Many aspects of MCGR treatment have been investigated, but pain in conjunction with distraction is only sparsely described in the literature. METHODS: Pain intensity was assessed in 25 EOS patients before, during and after MCGR lengthening procedures in an outpatient setup. They underwent at least two (range 2-16) lengthening procedures prior to this study. The pain intensity was estimated using patient-reported Faces Pain Scale (FPS-R), caregiver-reported pain numeric rating scale (NRS), and NRS and revised Face, Legs, Activity, Cry, Consolability scale (r-FLACC) by two medically trained observers. The inter-rater reliability and correlation between instruments were analyzed. RESULTS: 23 of 25 EOS patients (8- to 16-year old) with mixed etiology were able to self-report pain. The average pain intensity was mild: median 1 (range 0-6) on all four instruments on a 0-to-10 scale. Afterward, 22/25 patients (88%) were completely pain free and the remaining 3 patients had a pain score of 1. MCGR stalling (i.e. clunking) was encountered in 14/25 (56%) of the patients without impact on the pain intensity. CONCLUSIONS: The average maximum pain intensities during the lengthening procedures were mild and pain ceased within few minutes. The inter-rater reliability was good to excellent for NRS and r-FLACC, and there were high correlations between all the four pain instruments, indicating high criterion validity. LEVEL OF EVIDENCE: Level IV, case series.

Optimal marker set assessment for motion capture of 3D mimic facial movements.

Nowadays, facial mimicry studies have acquired a great importance in the clinical domain and 3D motion capture systems are becoming valid tools for analysing facial muscles movements, thanks to the remarkable developments achieved in the 1990s. However, the face analysis domain suffers from a lack of valid motion capture protocol, due to the complexity of the human face. Indeed, a framework for defining the optimal marker set layout does not exist yet and, up to date, researchers still use their traditional facial point sets with manually allocated markers. Therefore, the study proposes an automatic approach to compute a minimum optimized marker layout to be exploited in facial motion capture, able to simplify the marker allocation without decreasing the significance level. Specifically, the algorithm identifies the optimal facial marker layouts selecting the subsets of linear distances among markers that allow to automatically recognizing with the highest performances, through a k-nearest neighbours classification technique, the acted facial movements. The marker layouts are extracted from them. Various validation and testing phases have demonstrated the accuracy, robustness and usefulness of the custom approach.

A Novel Eye Movement Data Transformation Technique that Preserves Temporal Information: A Demonstration in a Face Processing Task.

Existing research has shown that human eye-movement data conveys rich information about underlying mental processes, and that the latter may be inferred from the former. However, most related studies rely on spatial information about which different areas of visual stimuli were looked at, without considering the order in which this occurred. Although powerful algorithms for making pairwise comparisons between eye-movement sequences (scanpaths) exist, the problem is how to compare two groups of scanpaths, e.g., those registered with vs. without an experimental manipulation in place, rather than individual scanpaths. Here, we propose that the problem might be solved by projecting a scanpath similarity matrix, obtained via a pairwise comparison algorithm, to a lower-dimensional space (the comparison and dimensionality-reduction techniques we use are ScanMatch and t-SNE). The resulting distributions of low-dimensional vectors representing individual scanpaths can be statistically compared. To assess if the differences result from temporal scanpath features, we propose to statistically compare the cross-validated accuracies of two classifiers predicting group membership: (1) based exclusively on spatial metrics; (2) based additionally on the obtained scanpath representation vectors. To illustrate, we compare autistic vs. typically-developing individuals looking at human faces during a lab experiment and find significant differences in temporal scanpath features.

Revealing faces: Gender and cultural differences in facial prominence of selfies.

An international sample of 2754 selfies uploaded to Instagram that form part of the Selfiecity (www.selfiecity.net) research project (selfies originating from Bangkok, Berlin, London, Moscow, New York, and Sao Paolo) were examined to assess the existence of facial prominence differences in depictions of males and females and the variability of facial prominence among cultures. Results show that gender stereotypical bias resulting in greater facial prominence in depictions of men is present in selfies. The control of image creation and selection for publication by the persons presented in the images do not diminish this gender based bias. Also, when gender is controlled, significant differences exist in facial prominence among different cultures. Comparisons with various socio-cultural indicators indicate possible correlations of gender stereotypical bias to self-expression values, freedom of choice, people's influence on government's decisions, protection of freedom of speech and people's influence on issues in the professional and communal environment. This research does not find a correlation of gender based bias in selfies with gender equality or inequality measures among cultures.

Computational Assessment of Facial Expression Production in ASD Children.

In this paper, a computational approach is proposed and put into practice to assess the capability of children having had diagnosed Autism Spectrum Disorders (ASD) to produce facial expressions. The proposed approach is based on computer vision components working on sequence of images acquired by an off-the-shelf camera in unconstrained conditions. Action unit intensities are estimated by analyzing local appearance and then both temporal and geometrical relationships, learned by Convolutional Neural Networks, are exploited to regularize gathered estimates. To cope with stereotyped movements and to highlight even subtle voluntary movements of facial muscles, a personalized and contextual statistical modeling of non-emotional face is formulated and used as a reference. Experimental results demonstrate how the proposed pipeline can improve the analysis of facial expressions produced by ASD children. A comparison of system's outputs with the evaluations performed by psychologists, on the same group of ASD children, makes evident how the performed quantitative analysis of children's abilities helps to go beyond the traditional qualitative ASD assessment/diagnosis protocols, whose outcomes are affected by human limitations in observing and understanding multi-cues behaviors such as facial expressions.

Costs of reproduction are reflected in women's faces: Post-menopausal women with fewer children are perceived as more attractive, healthier and younger than women with more children.

OBJECTIVES: The costs associated with reproduction (i.e., gestation, lactation, childcare) have long-term negative consequences by elevating risk of disease and reducing lifespan. We tested the hypotheses that high parity, and thus high reproductive costs bear by women, is perceived by other people when they evaluate facial appearance of health, attractiveness and age of mothers. MATERIALS AND METHODS: Using computer software we created average facial images based on real photographs of post-menopausal women with varying number of children; 3 parity categories were created (1-2, 4-5, and 7-9 children). Study participants (N = 571) were asked to choose the face they perceived as more attractive, younger and healthier via two-alternative forced choice questions asked in three randomized blocks. RESULTS: Women who had given birth to fewer children were judged both by men and women as more attractive, younger and healthier than women with more children. In each category the lowest scores were received by women from highest parity category (7-9 children). DISCUSSION: Mechanisms behind the observed variation in facial appearance are not known but higher levels of oxidative stress among women with high parity may explain their faster aging and lower attractiveness in older age. These results suggest that costs of reproduction might affect women's physical appearance.

Split-Second Trustworthiness Detection From Faces in an Economic Game.

Economic interactions often imply to gauge the trustworthiness of others. Recent studies showed that when making trust decisions in economic games, people have some accuracy in detecting trustworthiness from the facial features of unknown partners. Here we provide evidence that this face-based trustworthiness detection is a fast and intuitive process by testing its performance at split-second levels of exposure. Participants played a Trust game, in which they made decisions whether to trust another player based on their picture. In two studies, we manipulated the exposure time of the picture. We observed that trustworthiness detection remained better than chance for exposure times as short as 100 ms, although it disappeared with an exposure time of 33 ms. We discuss implications for ongoing debates on the use of facial inferences for social and economic decisions.

Nonsurgical Facial Rejuvenation Procedures in Patients Under 50 Prior to Undergoing Facelift: Habits, Costs, and Results.

Background: Facial rejuvenation in patients younger than 50 years of age has experienced an unprecedented growth with multimodality nonsurgical and less invasive rhytidectomy techniques. Objectives: To analyze the nonsurgical treatment habits of patients prior to undergoing rhytidectomy at <50 years of age. Methods: Retrospective study to enlist patients who underwent primary rhytidectomy at age <50 years between January 1, 2003 and December 31, 2013 by the senior author (AAJ) to complete a survey. Results: One hundred and fifty-seven patients were surveyed. Patients had nonsurgical rejuvenation starting at an average age of 37 years and rhytidectomy at an average age of 44 years. Thirty-two percent of responders had injectable treatments prior to their facelift, reporting a mean of 7 rounds of injectable treatments prior to pursuing rhytidectomy. Sixteen percent of responders had laser skin resurfacing undergoing 4 separate treatments prior to rhytidectomy, and 10% had energy-based facial tightening treatments one time prior to their rhytidectomy. Average expenditure on nonsurgical treatments prior to rhytidectomy was $7000 cumulatively. Fifty-nine percent of patients who went on to rhytidectomy did not report regret over this cost expenditure. Patients reported that they appeared 4 years younger after nonsurgical intervention, and 8 years younger after their facelift, a statistically significant difference (P = .048). Conclusions: Patients undergoing rhytidectomy <50 years old begin less invasive facial rejuvenation treatments at an even earlier age. The majority of these patients did not regret the costs associated with noninvasive treatments, even though they saw that rhytidectomy provided a greater rejuvenation effect. Rhytidectomy surgeons should incorporate nonsurgical techniques into their practice to best serve the needs of the modern aging face patient.

Objective estimation of patient age through a new composite scale for facial aging assessment: The face - Objective assessment scale.

Most patients requesting aesthetic rejuvenation treatment expect to look healthier and younger. Some scales for ageing assessment have been proposed, but none is focused on patient age prediction. The aim of this study was to develop and validate a new facial rating scale assessing facial ageing sign severity. One thousand Caucasian patients were included and assessed. The Rasch model was used as part of the validation process. A score was attributed to each patient, based on the scales we developed. The correlation between the real age and scores obtained, the inter-rater reliability and test-retest reliability were analysed. The objective was to develop a tool enabling the assigning of a patient to a specific age range based on the calculated score. All scales exceeded criteria for acceptability, reliability and validity. The real age strongly correlated with the total facial score in both sex groups. The test-retest reliability confirmed this strong correlation. We developed a facial ageing scale which could be a useful tool to assess patients before and after rejuvenation treatment and an important new metrics to be used in facial rejuvenation and regenerative clinical research.

A Methodology for the Analysis of Spontaneous Reactions in Automated Hearing Assessment.

Audiology is the science of hearing and auditory processes study. The evaluation of hearing capacity is commonly performed by an audiologist using an audiometer, where the patient is asked to show some kind of sign when he or she recognizes the stimulus. This evaluation becomes much more complicated when the patient suffers some type of cognitive decline that hinders the emission of visible signs of recognition. With this group of patients, a typical question-answer interaction is not applicable, so the audiologist must focus his attention on the patient's spontaneous gestural reactions. This manual evaluation entails a number of problems: it is highly subjective, difficult to determine in real time (since the expert must pay attention simultaneously to the audiological process and the patient's reactions), etc. Considering this, in this paper, we present an automatic methodology for processing video sequences recorded during the performance of the hearing test in order to assist the audiologist in the detection of these spontaneous reactions. This screening method analyzes the movements that occur within the eye area, which has been pointed out by the audiologists as the most representative for these patients. By the analysis of these movements, the system helps the audiologist to determine when a positive gestural reaction has taken place increasing the objectivity and reproducibility.

Women's attitudes to beauty, aging, and the place of cosmetic procedures: insights from the QUEST Observatory.

BACKGROUND: The quest for beauty has been a constant theme in human history since the earliest civilizations. The QUEST Observatory, an online observational study, investigated how women continue the pursuit of beauty in the 21st century by examining women's perceptions of facial attractiveness and the strategies they adopt to combat the effects of time on their faces. AIMS: To investigate women's attitudes toward beauty, aging, and the place of minimally invasive cosmetic procedures and anti-aging skincare. PATIENTS/METHODS: An in-depth questionnaire was developed by experts in dermatology, esthetic medicine, and social anthropology as the basis for this online, observational study. A nationally representative sample of 1000 French women aged between 25 and 70 years took part in the study. RESULTS: The main criteria for beauty were identified as a natural look, self-confidence, and attractive skin. A woman is considered to be at the peak of beauty in her mid-thirties just before early signs of facial aging begin to appear. Approximately 50% of women contemplate cosmetic procedures, but less than 10% go ahead. Confidence in the practitioner and good postprocedure follow-up are as influential as efficacy, safety, and cost in decisions about cosmetic procedures. CONCLUSIONS: The QUEST Observatory sheds valuable light on factors that affect women's choices regarding strategies for anti-aging and cosmetic procedures. These findings will help esthetic practitioners to better understand their patients and to meet their expectations.

Objectifying facial expressivity assessment of Parkinson's patients: preliminary study.

Patients with Parkinson's disease (PD) can exhibit a reduction of spontaneous facial expression, designated as "facial masking," a symptom in which facial muscles become rigid. To improve clinical assessment of facial expressivity of PD, this work attempts to quantify the dynamic facial expressivity (facial activity) of PD by automatically recognizing facial action units (AUs) and estimating their intensity. Spontaneous facial expressivity was assessed by comparing 7 PD patients with 8 control participants. To voluntarily produce spontaneous facial expressions that resemble those typically triggered by emotions, six emotions (amusement, sadness, anger, disgust, surprise, and fear) were elicited using movie clips. During the movie clips, physiological signals (facial electromyography (EMG) and electrocardiogram (ECG)) and frontal face video of the participants were recorded. The participants were asked to report on their emotional states throughout the experiment. We first examined the effectiveness of the emotion manipulation by evaluating the participant's self-reports. Disgust-induced emotions were significantly higher than the other emotions. Thus we focused on the analysis of the recorded data during watching disgust movie clips. The proposed facial expressivity assessment approach captured differences in facial expressivity between PD patients and controls. Also differences between PD patients with different progression of Parkinson's disease have been observed.

Understanding eye movements in face recognition using hidden Markov models.

We use a hidden Markov model (HMM) based approach to analyze eye movement data in face recognition. HMMs are statistical models that are specialized in handling time-series data. We conducted a face recognition task with Asian participants, and model each participant's eye movement pattern with an HMM, which summarized the participant's scan paths in face recognition with both regions of interest and the transition probabilities among them. By clustering these HMMs, we showed that participants' eye movements could be categorized into holistic or analytic patterns, demonstrating significant individual differences even within the same culture. Participants with the analytic pattern had longer response times, but did not differ significantly in recognition accuracy from those with the holistic pattern. We also found that correct and wrong recognitions were associated with distinctive eye movement patterns; the difference between the two patterns lies in the transitions rather than locations of the fixations alone.

Behavioral assessment of emotional and motivational appraisal during visual processing of emotional scenes depending on spatial frequencies.

Previous studies performed on visual processing of emotional stimuli have revealed preference for a specific type of visual spatial frequencies (high spatial frequency, HSF; low spatial frequency, LSF) according to task demands. The majority of studies used a face and focused on the appraisal of the emotional state of others. The present behavioral study investigates the relative role of spatial frequencies on processing emotional natural scenes during two explicit cognitive appraisal tasks, one emotional, based on the self-emotional experience and one motivational, based on the tendency to action. Our results suggest that HSF information was the most relevant to rapidly identify the self-emotional experience (unpleasant, pleasant, and neutral) while LSF was required to rapidly identify the tendency to action (avoidance, approach, and no action). The tendency to action based on LSF analysis showed a priority for unpleasant stimuli whereas the identification of emotional experience based on HSF analysis showed a priority for pleasant stimuli. The present study confirms the interest of considering both emotional and motivational characteristics of visual stimuli.

Use of ambient light in remote photoplethysmographic systems: comparison between a high-performance camera and a low-cost webcam.

Imaging photoplethysmography (PPG) is able to capture useful physiological data remotely from a wide range of anatomical locations. Recent imaging PPG studies have concentrated on two broad research directions involving either high-performance cameras and or webcam-based systems. However, little has been reported about the difference between these two techniques, particularly in terms of their performance under illumination with ambient light. We explore these two imaging PPG approaches through the simultaneous measurement of the cardiac pulse acquired from the face of 10 male subjects and the spectral characteristics of ambient light. Measurements are made before and after a period of cycling exercise. The physiological pulse waves extracted from both imaging PPG systems using the smoothed pseudo-Wigner-Ville distribution yield functional characteristics comparable to those acquired using gold standard contact PPG sensors. The influence of ambient light intensity on the physiological information is considered, where results reveal an independent relationship between the ambient light intensity and the normalized plethysmographic signals. This provides further support for imaging PPG as a means for practical noncontact physiological assessment with clear applications in several domains, including telemedicine and homecare.

Validated composite assessment scales for the global face.

BACKGROUND: Twenty grading scales have been developed to assess age-related facial changes. Until now, the validity with regard to the patient's actual age and the clinical importance of combined measurement tools to describe facial aging was unclear. OBJECTIVE: To investigate the reliability and validity of a total face score and three global face assessment scales for estimated age, estimated aesthetic treatment effort, and signs of aging in the facial units. MATERIALS AND METHODS: Descriptive, reliability, correlation, and principal component analyses based on the assessment of 50 subjects by 12 raters using the 20 grading scales and the global face assessment scales. RESULTS: Inter- and intrarater reliability was high for the total face score and for the scales on estimated age and aesthetic treatment effort. Actual age was highly correlated with these three measures. Facial aging was indicated particularly by scales of the lower face. CONCLUSION: The aesthetic grading scales and global scales on estimated age and aesthetic treatment effort are reliable and valid instruments. The results suggest that a more-comprehensive evaluation of the human face and its age-related changes can help to identify important areas of facial aging and to define optimal aesthetic treatment strategies.