Implementation of Facial Expression Recognition (FER) Using Convolutional Neural Network (CNN)

• Published in: 2024 IEEE 15th Control and System Graduate Research Colloquium, ICSGRC 2024 - Conference Proceeding
• Main Author: Abu Mangshor N.N.; Ishak N.H.; Zainurin M.H.; Rashid N.A.M.; Mohd Johari N.F.; Sabri N.
• Format: Conference paper
• Language: English
• Published: Institute of Electrical and Electronics Engineers Inc. 2024
• Online Access: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85206616983&doi=10.1109%2fICSGRC62081.2024.10691228&partnerID=40&md5=7ecd34bc7ed0cd1498d0bc2d90d47a0d

Humans use facial expressions as a non-verbal medium of communication which commonly reflects how they are doing and their mood. The present study benefits from facial expressions by having a Facial Expression Recognition (FER) system that recognizes such expressions and produces an output matching each expression. A Convolutional Neural Network (CNN) model is trained to perform the facial expression recognition task. This model would distinguish six (6) types of facial expressions including anger, happy, sadness, fear, surprised, and neutral. Firstly, the trained CNN model was imported into an integrated development environment and a webcam was employed to record the user's facial expression in real-time. Next, the model will recognize the video recording captured by the webcam once it is fed into the system. With each recognized expression, a counter would be incremented. As the counter approached the minimal criteria, an output in the form of a recommendation would be displayed to the user. Based on the testing conducted, the developed FER system achieved an average accuracy of 93.61%. In addition, the specificity and the sensitivity scores obtained are 95.93% and 80.00%, respectively. This indicates the implementation of CNN in recognizing facial expressions is promising and convincing. In the future, it is preferable to use a dataset with a more significant and equal number of images in various circumstances. © 2024 IEEE.