TY - JOUR
T1 - Hierarchical convolutional neural networks for fashion image classification
AU - Seo, Yian
AU - Shin, Kyung shik
N1 - Publisher Copyright:
© 2018 Elsevier Ltd
PY - 2019/2
Y1 - 2019/2
N2 - Deep learning can be applied in various business fields for better performance. Especially, fashion-related businesses have started to apply deep learning techniques on their e-commerce such as apparel recognition, apparel search and retrieval engine, and automatic product recommendation. The most important backbone of these applications is the image classification task. However, apparel classification can be difficult due to its various apparel properties, and complexity in the depth of categorization. In other words, multi-class apparel classification can be hard and ambiguous to separate among similar classes. Here, we find the need of image classification reflecting hierarchical structure of apparel categories. In most of the previous studies, hierarchy has not been considered in image classification when using Convolutional Neural Networks (CNN), and not even in fashion image classification using other methodologies. In this paper, we propose to apply Hierarchical Convolutional Neural Networks (H–CNN) on apparel classification. This study has contribution in that this is the first trial to apply hierarchical classification of apparel using CNN and has significance in that the proposed model is a knowledge embedded classifier outputting hierarchical information. We implement H–CNN using VGGNet on Fashion-MNIST dataset. Results have shown that when using H–CNN model, the loss gets decreased and the accuracy gets improved than the base model without hierarchical structure. We conclude that H–CNN brings better performance in classifying apparel.
AB - Deep learning can be applied in various business fields for better performance. Especially, fashion-related businesses have started to apply deep learning techniques on their e-commerce such as apparel recognition, apparel search and retrieval engine, and automatic product recommendation. The most important backbone of these applications is the image classification task. However, apparel classification can be difficult due to its various apparel properties, and complexity in the depth of categorization. In other words, multi-class apparel classification can be hard and ambiguous to separate among similar classes. Here, we find the need of image classification reflecting hierarchical structure of apparel categories. In most of the previous studies, hierarchy has not been considered in image classification when using Convolutional Neural Networks (CNN), and not even in fashion image classification using other methodologies. In this paper, we propose to apply Hierarchical Convolutional Neural Networks (H–CNN) on apparel classification. This study has contribution in that this is the first trial to apply hierarchical classification of apparel using CNN and has significance in that the proposed model is a knowledge embedded classifier outputting hierarchical information. We implement H–CNN using VGGNet on Fashion-MNIST dataset. Results have shown that when using H–CNN model, the loss gets decreased and the accuracy gets improved than the base model without hierarchical structure. We conclude that H–CNN brings better performance in classifying apparel.
KW - Classification
KW - Convolutional neural networks
KW - Fashion image
KW - Hierarchy
UR - http://www.scopus.com/inward/record.url?scp=85053758906&partnerID=8YFLogxK
U2 - 10.1016/j.eswa.2018.09.022
DO - 10.1016/j.eswa.2018.09.022
M3 - Article
AN - SCOPUS:85053758906
SN - 0957-4174
VL - 116
SP - 328
EP - 339
JO - Expert Systems with Applications
JF - Expert Systems with Applications
ER -