eprintid: 5423 rev_number: 9 eprint_status: archive userid: 2 dir: disk0/00/00/54/23 datestamp: 2023-01-13 23:30:04 lastmod: 2023-07-12 23:30:27 status_changed: 2023-01-13 23:30:04 type: article metadata_visibility: show creators_name: Qazi, Awais Salman creators_name: Farooq, Muhammad Shoaib creators_name: Rustam, Furqan creators_name: Gracia Villar, Mónica creators_name: Rodríguez Velasco, Carmen Lilí creators_name: Ashraf, Imran creators_id: creators_id: creators_id: creators_id: monica.gracia@uneatlantico.es creators_id: carmen.rodriguez@uneatlantico.es creators_id: title: Emotion Detection Using Facial Expression Involving Occlusions and Tilt ispublished: pub subjects: uneat_eng divisions: uneatlantico_produccion_cientifica divisions: unincol_produccion_cientifica divisions: uninimx_produccion_cientifica divisions: uninipr_produccion_cientifica divisions: unic_produccion_cientifica full_text_status: public keywords: facial expression recognition; convolutional neural network; machine learning; support vector machines abstract: Facial emotion recognition (FER) is an important and developing topic of research in the field of pattern recognition. The effective application of facial emotion analysis is gaining popularity in surveillance footage, expression analysis, activity recognition, home automation, computer games, stress treatment, patient observation, depression, psychoanalysis, and robotics. Robot interfaces, emotion-aware smart agent systems, and efficient human–computer interaction all benefit greatly from facial expression recognition. This has garnered attention as a key prospect in recent years. However, due to shortcomings in the presence of occlusions, fluctuations in lighting, and changes in physical appearance, research on emotion recognition has to be improved. This paper proposes a new architecture design of a convolutional neural network (CNN) for the FER system and contains five convolution layers, one fully connected layer with rectified linear unit activation function, and a SoftMax layer. Additionally, the feature map enhancement is applied to accomplish a higher detection rate and higher precision. Lastly, an application is developed that mitigates the effects of the aforementioned problems and can identify the basic expressions of human emotions, such as joy, grief, surprise, fear, contempt, anger, etc. Results indicate that the proposed CNN achieves 92.66% accuracy with mixed datasets, while the accuracy for the cross dataset is 94.94%. date: 2022-11 publication: Applied Sciences volume: 12 number: 22 pagerange: 11797 id_number: doi:10.3390/app122211797 refereed: TRUE issn: 2076-3417 official_url: http://doi.org/10.3390/app122211797 access: open language: en citation: Artículo Materias > Ingeniería Universidad Europea del Atlántico > Investigación > Producción Científica Fundación Universitaria Internacional de Colombia > Investigación > Producción Científica Universidad Internacional Iberoamericana México > Investigación > Producción Científica Universidad Internacional Iberoamericana Puerto Rico > Investigación > Producción Científica Universidad Internacional do Cuanza > Investigación > Producción Científica Abierto Inglés Facial emotion recognition (FER) is an important and developing topic of research in the field of pattern recognition. The effective application of facial emotion analysis is gaining popularity in surveillance footage, expression analysis, activity recognition, home automation, computer games, stress treatment, patient observation, depression, psychoanalysis, and robotics. Robot interfaces, emotion-aware smart agent systems, and efficient human–computer interaction all benefit greatly from facial expression recognition. This has garnered attention as a key prospect in recent years. However, due to shortcomings in the presence of occlusions, fluctuations in lighting, and changes in physical appearance, research on emotion recognition has to be improved. This paper proposes a new architecture design of a convolutional neural network (CNN) for the FER system and contains five convolution layers, one fully connected layer with rectified linear unit activation function, and a SoftMax layer. Additionally, the feature map enhancement is applied to accomplish a higher detection rate and higher precision. Lastly, an application is developed that mitigates the effects of the aforementioned problems and can identify the basic expressions of human emotions, such as joy, grief, surprise, fear, contempt, anger, etc. Results indicate that the proposed CNN achieves 92.66% accuracy with mixed datasets, while the accuracy for the cross dataset is 94.94%. metadata Qazi, Awais Salman; Farooq, Muhammad Shoaib; Rustam, Furqan; Gracia Villar, Mónica; Rodríguez Velasco, Carmen Lilí y Ashraf, Imran mail SIN ESPECIFICAR, SIN ESPECIFICAR, SIN ESPECIFICAR, monica.gracia@uneatlantico.es, carmen.rodriguez@uneatlantico.es, SIN ESPECIFICAR (2022) Emotion Detection Using Facial Expression Involving Occlusions and Tilt. Applied Sciences, 12 (22). p. 11797. ISSN 2076-3417 document_url: http://repositorio.unib.org/id/eprint/5423/1/applsci-12-11797-v2.pdf