Machine-Learning-Based Fine Tuning of Input Signals for Mechano-Tactile Display.

Deducing the input signal for a tactile display to present the target surface (i.e., solving the inverse problem for tactile displays) is challenging. We proposed the encoding and presentation (EP) method in our prior work, where we encoded the target surface by scanning it using an array of piezoelectric devices (encoding) and then drove the piezoelectric devices using the obtained signals to display the surface (presentation). The EP method reproduced the target texture with an accuracy of over 80% for the five samples tested, which we refer to as replicability. Machine learning is a promising method for solving inverse problems. In this study, we designed a neural network to connect the subjective evaluation of tactile sensation and the input signals to a display; these signals are described as time-domain waveforms. First, participants were asked to touch the surface presented by the mechano-tactile display based on the encoded data from the EP method. Then, the participants recorded the similarity of the surface compared to five material samples, which were used as the input. The encoded data for the material samples were used as the output to create a dataset of 500 vectors. By training a multilayer perceptron with the dataset, we deduced new inputs for the display. The results indicate that using machine learning for fine tuning leads to significantly better accuracy in deducing the input compared to that achieved using the EP method alone. The proposed method is therefore considered a good solution for the inverse problem for tactile displays.

Your Health Is Leaked: PPG Waveform Reconstruction Using Stealthily Recorded Physiological Signals.

In this study, we propose a method to reconstruct photoplethysmogram (PPG) waveforms from other stealthily recorded physiological signals. The proposed method focuses on the frequency characteristics between two physiological signals and reconstructs the target PPG waveform using a regression model. We investigate the feasibility of the proposed method to reconstruct target PPG signals from respiratory (RSP) and PPG signals recorded at non-genuine measurement sites using the two datasets of physiological signals. The results indicate that the proposed method achieves similarities between the target PPG and reconstructed PPG signals with correlation coefficients more than 0.860.

Characterization of an Electrode-Type Tactile Display Using Electrical and Electrostatic Friction Stimuli.

Unlike tactile displays that use mechanical actuators, electrode-type tactile displays can be easily integrated and miniaturized because they consist of electrodes and insulators. Electrical tactile displays only require electrodes and use an electric current to stimulate vibration or pressure. Likewise, electrostatic friction tactile displays also only require electrodes and an insulator and can induce changes in friction between the display and a fingerpad. We have developed a tactile display that integrates electrical and electrostatic friction stimulation owing to their affinity to microfabrication techniques. This tactile display can provide both pressure and friction at the same time. In this study, we presented an elongated bar shape via the tactile display to experimental participants. The experimental results showed that a tactile display employing multiple stimuli as opposed to a single stimulus can induce the perception of larger shapes.

Attack on PPG Biometrics: Presentation Attack by Stealth Recording and Waveform Estimation.

To develop a photoplethysmogram (PPG)-based authentication system with countermeasures, we investigate a "presentation attack" against the authentication. The attack uses the PPG for performing measurements on various sites on each subject's body. It records PPG on a nongenuine measurement site stealthily, generates a spoofing signal based on the recorded PPG, and transmits the signal to the authentication device. To investigate the feasibility of the attack, we developed a PPG-based authentication system. We recorded the PPGs of the subjects' bodies using the developed system and investigated the feasibility of attack in the experiment. The results indicated that an attack can occur with a probability of more than 80 % under ideal conditions.

Photoplethysmographic Subject Identification by Considering Feature Values Derived from Heartbeat and Respiration.

This research proposes a subject identification method using PPG (Photoplethysmogram) signals towards continuous authentication. The proposed method uses feature values derived from heartbeat and respiration extracted from PPG signals by means of frequency filtering and MFCC (Mel-Frequency Cepstrum Coefficients) to identify subjects. An experiment was conducted using an open dataset containing PPG signals to investigate the identification performance of the method. The feature values were extracted from the PPG signals and classifiers were generated to evaluate the performance of the method. As a result, the proposed method was found to be capable of identifying 46 people with the accuracy of 92.9 % by using feature values derived from heartbeat and respiration.

Fundamental Perceptual Characterization of an Integrated Tactile Display with Electrovibration and Electrical Stimuli.

Tactile displays have been widely studied for many decades. Although multiple tactile stimuli are more effective to improve the quality of the presented tactile sensation, most tactile displays provide a single tactile stimulus. An integrated tactile display with electrovibration and electrical stimuli is proposed herein. It is expected that vibrational friction, pressure and vibration can be presented at the same time through the tactile display. Also, these stimuli only require electrodes for stimulation. Therefore, the tactile display can be easily miniaturized and densely arrayed on a substrate. In this study, a tactile display is designed and fabricated using the micro-fabrication process. Furthermore, the display is evaluated. First, the relationship between a single stimulus and the perception is investigated. The electrovibration and electrical stimuli have a frequency dependence on perception. Second, whether the multiple stimuli with the electrovibration and electrical stimuli are perceivable by the subjects is also evaluated. The results indicate that the multiple tactile stimuli are perceivable by the subjects. Also, the possibility that the electrovibration and electrical stimuli affect each other is confirmed.

Development of a Fully Flexible Sheet-Type Tactile Display Based on Electrovibration Stimulus.

Tactile displays have been extensively studied for several decades. However, owing to their bulkiness and stiffness, it has been difficult to integrate these displays with information devices to enable tactile communication between the devices and their users. This paper proposes a novel sheet-type electrovibration tactile display that consists of poly(3,4-ethylenedioxythiophene) polystyrene sulfonate conductive layers and an insulation layer of polydimethylsiloxane. The tactile display is sufficiently thin and flexible for attaching onto various surfaces. In this study, the tactile display was micro-fabricated and characterized through experiments. The experimental results indicated that the tactile display exhibited good durability under bending and that it could present various tactile sensations depending on the type of voltage waveform. In addition, the effect of using a combination of electrovibration and thermal stimuli was also demonstrated. The sheet-type display was attached onto a Peltier element; the thinness of the structure enabled the display to conform to the element and ensure good heat transfer. In the experiment, subjects were asked to scan the display with their fingertips. The results showed that multiple tactile stimuli were also successfully perceived by the subjects.

Evaluation of Electrovibration Stimulation with a Narrow Electrode.

Recently, electrovibration tactile displays were studied and applied to several use cases by researchers. The high-resolution electrode for electrovibration stimulus will contribute to the presentation of a more realistic tactile sensation. However, the sizes of the electrodes that have been used thus far are of the millimeter-order. In this study, we evaluated whether a single narrow electrode was able to provide the electrovibration stimulus adequately. The widths of the prepared electrodes were 10, 20, 50, 100, 200, and 500 µm. We conducted a sensory experiment to characterize each electrode. The electrodes with widths of 50 µm or less were not durable or suitable for the applied signal, although the subjects perceived the stimulus. Therefore, we conducted the experiment without using these non-durable electrodes. The voltage waveform condition affected perception, and the subjects were not sensitive to the electrovibration stimulus at low frequencies. In addition, the stroke direction of the fingertip had a significant effect on perception under certain conditions. The results indicate that electrovibration stimulation requires an electrode with a width of only a few hundred micrometers for stimulation.