Visual and Thermal Image Processing for Facial Specific Landmark Detection to Infer Emotions in a Child-Robot Interaction.

Child-Robot Interaction (CRI) has become increasingly addressed in research and applications. This work proposes a system for emotion recognition in children, recording facial images by both visual (RGB-red, green and blue) and Infrared Thermal Imaging (IRTI) cameras. For this purpose, the Viola-Jones algorithm is used on color images to detect facial regions of interest (ROIs), which are transferred to the thermal camera plane by multiplying a homography matrix obtained through the calibration process of the camera system. As a novelty, we propose to compute the error probability for each ROI located over thermal images, using a reference frame manually marked by a trained expert, in order to choose that ROI better placed according to the expert criteria. Then, this selected ROI is used to relocate the other ROIs, increasing the concordance with respect to the reference manual annotations. Afterwards, other methods for feature extraction, dimensionality reduction through Principal Component Analysis (PCA) and pattern classification by Linear Discriminant Analysis (LDA) are applied to infer emotions. The results show that our approach for ROI locations may track facial landmarks with significant low errors with respect to the traditional Viola-Jones algorithm. These ROIs have shown to be relevant for recognition of five emotions, specifically disgust, fear, happiness, sadness, and surprise, with our recognition system based on PCA and LDA achieving mean accuracy (ACC) and Kappa values of 85.75% and 81.84%, respectively. As a second stage, the proposed recognition system was trained with a dataset of thermal images, collected on 28 typically developing children, in order to infer one of five basic emotions (disgust, fear, happiness, sadness, and surprise) during a child-robot interaction. The results show that our system can be integrated to a social robot to infer child emotions during a child-robot interaction.

Cross-phase-modulation-induced spectral effects in high-efficiency picosecond fiber optical parametric oscillators.

We explore the spectral effects due to cross-phase modulation and walk-off in picosecond fiber optical parametric oscillators. The output spectrum exhibits pump-power-dependent broadening, which can be quite asymmetric associated with a redshift or a blueshift depending on pump synchronization. By slightly increasing the cavity length, one obtains a blueshifted spectrum and a conversion efficiency as high as 15%.

Emotion analysis in children through facial emissivity of infrared thermal imaging.

Physiological signals may be used as objective markers to identify emotions, which play relevant roles in social and daily life. To measure these signals, the use of contact-free techniques, such as Infrared Thermal Imaging (IRTI), is indispensable to individuals who have sensory sensitivity. The goal of this study is to propose an experimental design to analyze five emotions (disgust, fear, happiness, sadness and surprise) from facial thermal images of typically developing (TD) children aged 7-11 years using emissivity variation, as recorded by IRTI. For the emotion analysis, a dataset considered emotional dimensions (valence and arousal), facial bilateral sides and emotion classification accuracy. The results evidence the efficiency of the experimental design with interesting findings, such as the correlation between the valence and the thermal decrement in nose; disgust and happiness as potent triggers of facial emissivity variations; and significant emissivity variations in nose, cheeks and periorbital regions associated with different emotions. Moreover, facial thermal asymmetry was revealed with a distinct thermal tendency in the cheeks, and classification accuracy reached a mean value greater than 85%. From the results, the emissivity variations were an efficient marker to analyze emotions in facial thermal images, and IRTI was confirmed to be an outstanding technique to study emotions. This study contributes a robust dataset to analyze the emotions of 7-11-year-old TD children, an age range for which there is a gap in the literature.

Designing antibiotic cycling strategies by determining and understanding local adaptive landscapes.

The evolution of antibiotic resistance among bacteria threatens our continued ability to treat infectious diseases. The need for sustainable strategies to cure bacterial infections has never been greater. So far, all attempts to restore susceptibility after resistance has arisen have been unsuccessful, including restrictions on prescribing [1] and antibiotic cycling [2], [3]. Part of the problem may be that those efforts have implemented different classes of unrelated antibiotics, and relied on removal of resistance by random loss of resistance genes from bacterial populations (drift). Here, we show that alternating structurally similar antibiotics can restore susceptibility to antibiotics after resistance has evolved. We found that the resistance phenotypes conferred by variant alleles of the resistance gene encoding the TEM ß-lactamase (bla(TEM)) varied greatly among 15 different ß-lactam antibiotics. We captured those differences by characterizing complete adaptive landscapes for the resistance alleles bla(TEM-50) and bla(TEM-85), each of which differs from its ancestor bla(TEM-1) by four mutations. We identified pathways through those landscapes where selection for increased resistance moved in a repeating cycle among a limited set of alleles as antibiotics were alternated. Our results showed that susceptibility to antibiotics can be sustainably renewed by cycling structurally similar antibiotics. We anticipate that these results may provide a conceptual framework for managing antibiotic resistance. This approach may also guide sustainable cycling of the drugs used to treat malaria and HIV.

Analysis of the use of a robot to improve social skills in children with autism spectrum disorder

Abstract Introduction Autism Spectrum Disorder is a set of developmental disorders that imply in poor social skills, lack of interest in activities and interaction with people. Treatments rely on teaching social skills and in such therapies robotics may offer aid. This work is a pilot study, which aims to show the development and usage of a ludic mobile robot for stimulating social skills in ASD children. Methods A mobile robot with a special costume and a monitor to display multimedia contents was designed to interact with ASD children. A mediator controls the robot’s movements in a room prepared for interactive sessions. Sessions are recorded to assess the following social skills: eye gazing, touching the robot and imitating the mediator. The interaction is evaluated using the Goal Attainment Scale and Likert scale. Ten children were evaluated (50% with ASD), using as inclusion criteria children with age 7-8, without use of medication, and without tendency to aggression or stereotyped movements. Results It was observed that the ASD group touched the robot about twice more in average than the control group (CG). They also looked away and imitated the mediator in a quite similar way as the CG, and showed extra social skills (verbal and non-verbal communication). These results are considered an advance in terms of improvement of social skills in ASD children. Conclusions Our studies indicate that the robot stimulated social skills in 4/5 of the ASD children, which shows that its concepts are useful to improve socialization and quality of life.

Multimodal coherent anti-Stokes Raman spectroscopic imaging with a fiber optical parametric oscillator.

We report on multimodal coherent anti-Stokes Raman scattering (CARS) imaging with a source composed of a femtosecond fiber laser and a photonic crystal fiber (PCF)-based optical parametric oscillator (FOPO). By switching between two PCFs with different zero dispersion wavelengths, a tunable signal beam from the FOPO covering the range from 840 to 930 nm was produced. By combining the femtosecond fiber laser and the FOPO output, simultaneous CARS imaging of a myelin sheath and two-photon excitation fluorescence imaging of a labeled axons in rat spinal cord have been demonstrated at the speed of 20 µs per pixel.