RUS  ENG
Полная версия
ЖУРНАЛЫ // Компьютерная оптика

Компьютерная оптика, 2023, том 47, выпуск 5, страницы 806–815 (Mi co1182)

Распознавание выражений лиц на основе адаптации классификатора видеоданных пользователя
Е. Н. Чураев, А. В. Савченко

Список литературы

1. Ekman P, “Basic emotions”, Handbook of cognition and emotion, eds. Dalgleish T, Power MJ, John Wiley & Sons, New York, 1991, 45–60  crossref  mathscinet
2. Livingstone SR, Russo FA, “The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English”, PloS One, 13:5 (2018), e0196391  crossref
3. Mollahosseini A, Hasani B, Mahoor MH, “AffectNet: A database for facial expression, valence, and arousal computing in the wild”, IEEE Trans Affect Comput, 10:1 (2017), 18–31  crossref
4. Chang WY, Hsu SH, Chien JH, “FATAUVA-Net: An integrated deeplearning framework for facial attribute recognition, action unit detection, and valence-arousal estimation”, 2017 IEEE Conf on Computer Vision and Pattern Recognition Workshops (CVPRW), 2017, 17–25  crossref
5. Arunnehru J, Kalaiselvi Geetha M, “Automatic human emotion recognition in surveillance video”, Intelligent techniques in signal processing for multimedia security, eds. Dey N, Santhi V, Springer International Publishing Switzerland, Cham, 2017, 321–342  crossref
6. Lee KW, Yoon HS, Song JM, Park KR, “Convolutional neural network-based classification of driver’s emotion during aggressive and smooth driving using multi-modal camera sensors”, Sensors, 18:4 (2018), 957  crossref
7. Scherr SA, Elberzhager F, Holl K, “Acceptance testing of mobile applications – Automated emotion tracking for large user groups”, 2018 IEEE/ACM 5th Int Conf on Mobile Software Engineering and Systems (MOBILESoft), 2018, 247–251  crossref
8. Naas SA, Sigg S, “Real-time emotion recognition for sales”, 2020 16th Int Conf on Mobility, Sensing and Networking (MSN), 2020, 584–591  crossref
9. Tkalcic M, Kosir A, Tasic J, “Affective recommender systems: The role of emotions in recommender systems”, The RecSys 2011 Workshop on Human Decision Making in Recommender Systems, 2011, 9–13
10. Liu X, Xie L, Wang Y, Zou J, Xiong J, Ying Z, Vasilakos AV, “Privacy and security issues in deep learning: A survey”, IEEE Access, 9 (2020), 4566–4593  crossref
11. Savchenko AV, “Facial expression and attributes recognition based on multi-task learning of lightweight neural networks”, 2021 IEEE 19th Int Symposium on Intelligent Systems and Informatics (SISY), 2021, 119–124  crossref
12. Savchenko AV, Savchenko LV, Makarov I, “Classifying emotions and engagement in online learning based on a single facial expression recognition neural network”, IEEE Trans Affect Comput, 13:4 (2022), 2132–2143  crossref
13. Churaev E, Savchenko AV, “Touching the limits of a dataset in video-based facial expression recognition”, 2021 Int Russian Automation Conf (RusAutoCon), 2021, 633–638  crossref
14. Bagheri E, Bagheri A, Esteban PG, Vanderborgth B, “A novel model for emotion detection from facial muscles activity”, Robot 2019: Fourth Iberian robotics conference, eds. Silva MF, Lima JL, Reis LP, Sanfeliu A, Tardioli D, Springer, Cham, 2019, 237–249  crossref
15. Luna-Jiménez C, Grio D, Callejas Z, Kleinlein R, Montero JM, Fernández-Martínez F, “Multimodal emotion recognition on RAVDESS dataset using transfer learning”, Sensors, 21:22 (2021), 7665  crossref
16. Churaev E, Savchenko AV, “Multi-user facial emotion recognition in video based on user-dependent neural network adaptation”, 2022 VIII Int Conf on Information Technology and Nanotechnology (ITNT), 2022, 1–5  crossref
17. Savchenko L, Savchenko AV, “Speaker-aware training of speech emotion classifier with speaker recognition”, Speech and Computer, eds. Karpov A, Potapova R, Springer Nature Switzerland AG, Cham, 2021, 614–625  crossref
18. Li CJ, Spigner M, “Partially speaker-dependent automatic speech recognition using deep neural networks”, Journal of the South Carolina Academy of Science, 19:2 (2021), 93–99  mathscinet
19. Shan C, Gong S, McOwan PW, “Facial expression recognition based on local binary patterns: A comprehensive study”, Image Vis Comput, 27:6 (2009), 803–816  crossref
20. Wang Z, Ying Z, “Facial expression recognition based on local phase quantization and sparse representation”, 2012 8th Int Conf on Natural Computation, 2012, 222–225  crossref
21. Tan M, Le Q, “EfficientNet: Rethinking model scaling for convolutional neural networks”, Int Conf on Machine Learning, 2019, 6105–6114  mathscinet
22. Capotondi A, Rusci M, Fariselli M, Benini L, “CMix-NN: Mixed low-precision CNN library for memory-constrained edge devices”, IEEE Trans Circuits Syst II Express Briefs, 67:5 (2020), 871–875  crossref
23. Wang P, Fan E, Wang P, “Comparative analysis of image classification algorithms based on traditional machine learning and deep learning”, Pattern Recogn Lett, 141:11 (2021), 61–67  crossref  mathscinet
24. Lomotin K, Makarov I, “Automated image and video quality assessment for computational video editing”, Analysis of images, social networks and texts, eds. van der Aalst WMP, Batagelj V, Ignatov DI, Khachay M, Koltsova O, Kutuzov A, Kuznetsov SO, Lomazova IA, Loukachevitch N, Napoli A, Panchenko A, Pardalos PM, Pelillo M, Savchenko AV, Tutubalina E, Springer Nature Switzerland AG, Cham, 2021, 243–256  crossref
25. Zhang K, Zhang Z, Li Z, Qiao Y, “Joint face detection and alignment using multitask cascaded convolutional networks”, IEEE Signal Process Lett, 23:10 (2016), 1499–1503  crossref
26. Cao Q, Shen L, Xie W, Parkhi OM, Zisserman A, “VGGFace2: A dataset for recognising faces across pose and age”, 2018 13th IEEE Int Conf on Automatic Face & Gesture Recognition (FG 2018), 2018, 67–74  crossref
27. Barsoum E, Zhang C, Ferrer CC, Zhang Z, “Training deep networks for facial expression recognition with crowd-sourced label distribution”, ICMI '16: Proc 18th ACM Int Conf on Multimodal Interaction, 2016, 279–283  crossref
28. Meng D, Peng X, Wang K, Qiao Y, “Frame attention networks for facial expression recognition in videos”, 2019 IEEE Int Conf on Image Processing (ICIP), 2019, 3866–3870  crossref
29. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I, “Attention is all you need”, NIPS'17: Proceedings of the 31st International Conference on Neural Information Processing Systems, 2017, 6000–6010
30. Deng J, Guo J, Xue N, Zafeiriou S, “ArcFace: Additive angular margin loss for deep face recognition”, 2019 IEEE/CVF Conf on Computer Vision and Pattern Recognition (CVPR), 2019, 4690–4699  crossref
31. Jaratrotkamjorn A, Choksuriwong A, “Bimodal emotion recognition using deep belief network”, 2019 23rd Int Computer Science and Engineering Conf (ICSEC), 2019, 103–109  crossref
32. Alshamsi H, Kepuska V, Alshamsi H, Meng H, “Automated facial expression and speech emotion recognition app development on smart phones using cloud computing”, 2018 IEEE 9th Annual Information Technology, Electronics and Mobile Communication Conf (IEMCON), 2018, 730–738  crossref
33. Rzayeva Z, Alasgarov E, “Facial emotion recognition using convolutional neural networks”, 2019 IEEE 13th Int Conf on Application of Information and Communication Technologies (AICT), 2019, 1–5  crossref
34. He Z, Jin T, Basu A, Soraghan J, Di Caterina G, Petropoulakis L, “Human emotion recognition in video using subtraction pre-processing”, ICMLC '19: Proc 2019 11th Int Conf on Machine Learning and Computing, 2019, 374–379  crossref
35. Baltrušaitis T, Robinson P, Morency LP, “OpenFace: An open source facial behavior analysis toolkit”, 2016 IEEE Winter Conf on Applications of Computer Vision (WACV), 2016, 1–10  crossref
36. Noyes E, Davis JP, Petrov N, Gray KL, Ritchie KL, “The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers”, Royal Soc Open Sci, 8:3 (2021), 201169  crossref
37. Bhattacharya S, Gupta M, “A survey on: Facial emotion recognition invariant to pose, illumination and age”, 2019 Second Int Conf on Advanced Computational and Communication Paradigms (ICACCP), 2019, 1–6  crossref
38. Savchenko AV, “Personalized frame-level facial expression recognition in video”, Pattern recognition and artificial intelligence, eds. Yacoubi ME, Granger E, Yuen PC, Pal U, Vincent N, Springer Nature Switzerland AG, Cham, 2022, 447–458  crossref


© МИАН, 2025