Implementation of facial emotion recognition using CNN on jetson TX2

Authors

  • Pham Minh Quyen HCMC University of Technology and Education, Vietnam
  • Phung Thanh Huy HCMC University of Technology and Education, Vietnam
  • Do Duy Tan HCMC University of Technology and Education, Vietnam
  • Huynh Hoang Ha HCMC University of Technology and Education, Vietnam
  • Truong Quang Phuc HCMC University of Technology and Education, Vietnam

Corressponding author's email:

phuctq@hcmute.edu.vn

DOI:

https://doi.org/10.54644/jte.63.2021.38

Keywords:

recognition, facial emotion, neural network, CNN, Jetson TX2

Abstract

In this paper, a convolutional neural network (CNN), one of the most popular deep learning architectures used for facial extraction research, has been implemented on NVIDIA Jetson TX2 hardware. Different from many existing approaches investigating CNN with complex structure and large parameters, we have focused on building a robust neural network through extensive performance comparison and evaluation. In addition, we have collected a dataset using a built-in camera on a laptop computer. Specifically, we have applied our model on Jetson TX2 hardware to take advantage of the computational power of the embedded GPU to optimize computation time and data training. In particular, both FER2013 and RAF datasets with seven basic emotions have been used for training and testing purposes. Finally, the evaluation results show that the proposed method achieves an accuracy of up to 72% on the testing dataset.

Downloads: 0

Download data is not yet available.

References

HeJun, Li Shuai, Shen Jinming, Liu Yue, Wang Jingwei, Jin Peng, "Facial Expression Recognition Based on VGGNet Convolutional Neural Network," 2018 Chinese Automation Congress (CAC), Xi'an, China, pp. 4146-4151, 2018. DOI: https://doi.org/10.1109/CAC.2018.8623238

Imane Lasri , Anouar Riad Solh , Mourad El Belkacemi, "Facial Emotion Recognition of Students using Convolutional Neural Network," 2019 Third International Conference on Intelligent Computing in Data Sciences (ICDS), Marrakech, Morocco, pp. 1-6, 2019. DOI: https://doi.org/10.1109/ICDS47004.2019.8942386

D. V. Sang, N. Van Dat and D. P. Thuan, "Facial expression recognition using deep convolutional neural networks," 2017 9th International Conference on Knowledge and Systems Engineering (KSE), Hue, 2017, pp. 130-135. DOI: https://doi.org/10.1109/KSE.2017.8119447

S. Turabzadeh, H. Meng, R. Swash, M. Pleva, and J. Juhar, “Facial Expression Emotion Detection for Real-Time Embedded Systems,” Technologies, vol. 6, no. 1, p. 17, Jan. 2018. DOI: https://doi.org/10.3390/technologies6010017

"Nvidia. Autonomous Machines," NVIDIA, [Online]. Available: https://developer.nvidia.com/embedded/develop/hardware?fbclid=IwAR2SmS-iYoKCWGrc6fysbbbd7t07Ly8dw-g9lfldJT-ilbP9aT28vSrFs8I.

Artiom Basulto-Lantsova , Jose A. Padilla-Medina , Francisco J. Perez-Pinal , Alejandro I. Barranco-Gutierrez, "Performance comparative of OpenCV Template Matching method on Jetson TX2 and Jetson Nano developer kits," 2020 10th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA, pp. 0812-0816, 2020. DOI: https://doi.org/10.1109/CCWC47524.2020.9031166

"Technical Specifications," NDIVIA, [Online]. Available: https://developer.nvidia.com/embedded/develop/hardware.

"Nvidia. Autonomous Machines," NVIDIA, [Online]. Available: https://developer.nvidia.com/embedded/develop/hardware?fbclid=IwAR2SmS-iYoKCWGrc6fysbbbd7t07Ly8dw-g9lfldJT-ilbP9aT28vSrFs8I.

J. Flores, "Training a TensorFlow model to recognize emotions," 24 May 2018. [Online]. Available: https://medium.com/@jsflo.dev/training-a-tensorflow-model-to-recognize-emotions-a20c3bcd6468.

Z.Zhang, "Improved Adam Optimizer for Deep Neural Networks," 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), Banff, AB, Canada, 2018, pp. 1-2. DOI: https://doi.org/10.1109/IWQoS.2018.8624183

Tee Connie , Mundher Al-Shabi , Wooi Ping Cheah, Michael Goh, " Facial Expression Recognition Using a Hybrid CNN–SIFT Aggregator," Multi-disciplinary Trends in Artificial Intelligence (MIWAI), Lecture Notes in Computer Science, vol 10607, 2017. DOI: https://doi.org/10.1007/978-3-319-69456-6_12

Published

29-04-2021

How to Cite

[1]
Pham Minh Quyen, Phung Thanh Huy, Do Duy Tan, Huynh Hoang Ha, and Truong Quang Phuc, “Implementation of facial emotion recognition using CNN on jetson TX2”, JTE, vol. 16, no. 2, pp. 11–18, Apr. 2021.

Most read articles by the same author(s)