Improved Histogram of Oriented Gradient (HOG) Feature Extraction for Facial Expressions Classification

Luthfiar Ramiady, Fitri Arnia, Maulisa Oktiana, Andri Novandri

Abstract


Facial expression classification system is one of the implementations of machine learning (ML) that takes facial expression datasets, undergoes training, and then utilizes the trained results to recognize facial expressions in new facial images. The recognized facial expressions include anger, contempt, disgust, fear, happy, sadness, and surprise expressions. The method employed for facial feature extraction utilizes histogram-oriented gradient (HOG). This study proposes an enhancement method for HOG feature extraction by reducing the feature dimension into multiple sub-features based on gradient orientation intervals, referred to as HOG channel (HOG-C). Classifier testing techniques are divided into two methods for comparison—support vector machines (SVM) with HOG features and SVM with HOG-C features. The testing results demonstrate that SVM with HOG achieves an accuracy of 99.9% with an average training time of 18.03 minutes, while SVM with HOG-C attains a 100% accuracy with an average training time of 18.09 minutes. The testing outcomes reveal that the implementation of SVM with HOG-C successfully enhances accuracy for facial expression classification.

Keywords


facial expression; histogram oriented gradient; machine learning; support vector machine

Full Text:

PDF

References


M. Pantic, “Facial expression recognition,” in Encyclopedia of Biometrics, Boston, MA: Springer US, 2009, pp. 400–406.

Y. Ma and G. Guo, Support Vector Machines Applications, vol. 649, New York: Springer, 2014, pp. 23– 48.

J. S. Prakash, K. A. Vignesh, C. Ashok, and R. Adithyan, “Multi class support vector machines classifier for machine vision application,” in Proc. Inter. Conf. on Machine Vision and Image Process., Dec. 2012, pp. 197–199.

A. Fathallah, L. Abdi, and A. Douik, “Facial expression recognition via deep learning,” in Proc. Inter. Conf. on Comp. Systems and Apps, Oct. 2017, pp. 745–750.

S. P. Yadav, “Emotion recognition model based on facial expressions,” Multimed. Tools Appl., vol. 80, no. 17, pp. 26357–26379, July 2021.

L. Yang, H. Zhang, D. Li, F. Xiao, and S. Yang, “Facial expression recognition based on transfer learning and SVM,” Journal of Physics: Conference Series, vol. 2025, no. 1, pp. 012015, Sep 2021.

K. Candra Kirana, S. Wibawanto, and H. Wahyu Herwanto, “Facial emotion recognition based on viola-jones algorithm in the learning environment,” in Proc. Inter. Seminar on Application for Technology of Information and Communication: Creative Technology for Human Life, Sep. 2018, pp. 406–410.

P. N. Maraskolhe and A. S. Bhalchandra, “Analysis of facial expression recognition using histogram of oriented gradient (HOG),” in Proc. Inter. Conf. on Electronics and Communication and Aerospace Technology, Jun. 2019, pp. 1007–1011.

C. Shu, X. Ding, and C. Fang, “Histogram of the oriented gradient for face recognition,” Tsinghua Sci. Technol., vol. 16, no. 2, pp. 216–224, Apr 2011.

P. Kumar, S. L. Happy, and A. Routray, “A real-time robust facial expression recognition system using hog features,” in Proc. Inter. Conf. on Computing, Analytics and Security Trends, Dec. 2016, pp. 289–293.

M. N. Chaudhari, M. Deshmukh, G. Ramrakhiani, and R. Parvatikar, “Face detection using viola jones algorithm and neural networks,” in Proc. Inter. Conf. on Computing, Communication Control and Automation, Aug. 2018, pp. 1–6.

F. Mahmud, S. Afroge, A. Mamun, and A. Matin, “PCA and back-propagation neural network based face recognition system,” in Proc. Inter. Conf. on Computer and Information Technology, Dec. 2015, pp. 582–587.

L. Zhang and D. Tjondronegoro, “Facial expression recognition using facial movement features,” IEEE Trans. Affect. Comput., vol. 2, no. 4, pp. 219–229, Oct 2011.

M. Lyons, S. Akamatsu, M. Kamachi, and J. Gyoba, “Coding facial expressions with gabor wavelets,” in Proc. Inter. Conf. on Automatic Face and Gesture Recognition, Apr. 1998, pp. 200–205.

S. Liu, X. Tang, and D. Wang, “Facial expression recognition based on sobel operator and improved CNN-SVM,” in Proc. Inter. Conf. on Information Communication and Signal Processing, Sep. 2020, pp. 236–240.

M. Pantic, A. Pentland, A. Nijholt, and T. S. Huang, “Human computing and machine understanding of human behavior: a survey,” Artifical Intell. Hum. Comput., vol. 4451, pp. 47–71, Jan 2007.

N. Kumar H N, A. S. Kumar, G. Prasad M S, and M. A. Shah, “Automatic facial expression recognition combining texture and shape features from prominent facial regions,” IET Image Process., vol. 17, no. 4, pp. 1111–1125, Mar 2023.

B. Islam, F. Mahmud, and A. Hossain, “High performance facial expression recognition system using facial region segmentation, fusion of HOG LBP features and multiclass SVM,” in Proc. Inter. Conf. on Electrical and Computer Engineering, Dec. 2018, pp. 42–45.

T. Ojala, M. Pietikäinen, and T. Mäenpää, “Multiresolution gray-scale and rotation invariant texture classification with local binary patterns,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 7, pp. 971–987, Jul 2002.

C. Tomasi. (view Feb. 2024). Histograms of oriented gradients. [Online]. Available: https://courses.cs.duke.edu/fall17/compsci527/notes/hog.pdf.

O. Déniz, G. Bueno, J. Salido, and F. De La Torre, “Face recognition using histograms of oriented gradients,” Pattern Recognit. Lett., vol. 32, no. 12, pp. 1598–1603, Sep 2011.

W. Li, H. Su, F. Pan, Q. Gao, and B. Quan, “A fast pedestrian detection via modified HOG feature,” in Proc. Inter. Conf. Chinese Control Conference, Jul. 2015, pp. 3870–3873.

N. Dalal and B. Triggs, “Histograms of oriented gradients for human detection,” in Proc. Inter. Conf. on Computer Vision and Pattern Recognition, Jun. 2005, vol. 1, pp. 886–893.

T. Surasak, I. Takahiro, C. H. Cheng, C. E. Wang, and P. Y. Sheng, “Histogram of oriented gradients for human detection in video,” in Proc. Inter. Conf. on Business and Industrial, May. 2018, pp. 172–176.

S. Setumin and S. A. Suandi, “Difference of gaussian oriented gradient histogram for face sketch to photo matching,” IEEE Access, vol. 6, pp. 39344–39352, Jul 2018.

H. I. Dino and M. B. Abdulrazzaq, “Facial expression classification based on SVM, KNN and MLP classifiers,” in Proc. Inter. Conf. on Advanced Science and Engineering, Apr. 2019, pp. 70–75.

C. V. R. Reddy, U. S. Reddy, and K. V. K. Kishore, “Facial emotion recognition using NLPCA and SVM,” Trait. du Signal, vol. 36, no. 1, pp. 13–22, Apr. 2019.

A. Matin, F. Mahmud, T. Ahmed, and M. S. Ejaz, “Weighted score level fusion of iris and face to identify an individual,” in Proc. Inter. Conf. on Electrical, Computer and Communication Engineering, Feb. 2017, pp. 1–4.

S. Salimov and J. H. Yoo, “A design of small scale deep cnn model for facial expression recognition using the low resolution image datasets,” Journal Korea Inst. Electron. Commun. Sci., vol. 16, no. 1, pp. 75–80, Feb 2021.

P. Lucey et al., “The extended cohn-kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression,” in Proc. Inter. Conf. on Computer Vision and Pattern Recognition Workshops, Jun. 2010, pp. 94–101.




DOI: https://doi.org/10.17529/jre.v20i3.34044

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


View My Stats

 

Creative Commons License

Jurnal Rekayasa Elektrika (JRE) is published under license of Creative Commons Attribution-ShareAlike 4.0 International License.