Interactive Deformable Colored Sound Display Achieved with Electrostrictive Fluoropolymer and Halide Perovskite.

The association of color and sound helps human cognition through a synergetic effect like intersensory facilitation. Although soft human-machine interfaces (HMIs) providing unisensory expression have been widely developed, achieving synchronized optic and acoustic expression in one device system has been relatively less explored. It is because their operating principles are different in terms of materials, and implementation has mainly been attempted through structural approaches. Here, a deformable sound display is developed that generates multiple colored lights with large sound at low input voltage. The device is based on alternating-current electroluminescence (ACEL) covered with perovskite composite films. A sound wave is created by a polymer matrix of the ACEL, while simultaneously, various colors are produced by the perovskite films and the blue electroluminescence (EL) emitted from the phosphors in the ACEL. By patterning different colored perovskite films onto the ACELs, associating the color and the sound is successfully demonstrated by a piano keyboard and a wearable interactive device.

A High-Fidelity Skin-Attachable Acoustic Sensor for Realizing Auditory Electronic Skin.

Wearable auditory sensors are critical in user-friendly sound-recognition systems for smart human-machine interaction and the Internet of Things. However, previously reported wearable sensors have limited sound-sensing quality as a consequence of a poor frequency response and a narrow acoustic-pressure range. Here, a skin-attachable acoustic sensor is presented that has higher sensing accuracy in wider auditory field than human ears, with flat frequency response (15-10 000 Hz) and a good range of linearity (29-134 dBSPL ) as well as high conformality to flexible surfaces and human skin. This high sound-sensing quality is achieved by exploiting the low residual stress and high processability of polymer materials in a diaphragm structure designed using acousto-mechano-electric modeling. Thus, this acoustic sensor shows high acoustic fidelity by sensing human-audible sounds, even loud sounds and low-frequency sounds that human ears cannot detect without distorting them. The polymer-based ultrasmall (<9 mm2 ) and thin sensor maintains sound-detection quality on flexible substrates and in a wide temperature range (25 to 90 °C). The acoustic sensor shows a significant potential of auditory electronic skin, by recognizing voice successfully when the sensor attached on human skin is connected to a commercial mobile device running the latest artificial intelligence assistant.