Skin patch based makeup finish assessment technique by deep neural network.

ABSTRACT

BACKGROUND: Skin color and texture play a significant role in influencing impressions. To understand the influence of skin appearance and to develop better makeup products, objective evaluation methods for makeup finish have been explored. This study aims to apply machine learning technology, specifically deep neural network (DNN), to accurately analyze and evaluate delicate and complex cosmetic skin textures. METHODS: "Skin patch datasets" were extracted from facial images and used to train a DNN model. The advantages of using skin patches include retaining fine texture, eliminating false correlations from non-skin features, and enabling visualization of the inferred results for the entire face. The DNN was trained in two ways a classification task to classify skin attributes and a regression task to predict the visual assessment of experts. The trained DNNs were applied for the evaluation of actual makeup conditions. RESULTS: In the classification task training, skin patch-based classifiers for age range, presence or absence of base makeup, formulation type (powder/liquid) of the applied base makeup, and immediate/while after makeup application were developed. The trained DNNs on regression task showed high prediction accuracy for the experts' visual assessment. Application of DNN to the evaluation of actual makeup conditions clearly showed appropriate evaluation results in line with the appearance of the makeup finish. CONCLUSION: The proposed method of using DNNs trained on skin patches effectively evaluates makeup finish. This approach has potential applications in visual science research and cosmetics development. Further studies can explore the analysis of different skin conditions and the development of personalized cosmetics.