EMOTION RECOGNITION METHOD FOR DISTANCE LEARNING SYSTEMS
Keywords:
Emotion recognition, distance learning, convolutional neural networkAbstract
This paper analyzes the existing emotion recognition solutions and the impact of emotions on the learning process. Based on the obtained results, the method of emotion recognition is proposed. It includes such steps as images collecting, image normalization, face detection, face identification, and emotion recognition. The collected information about audience emotional state could be used by a lecturer to indicate the level of understanding and adjust the teaching method to a specific audience or students.
References
Adesola S.A., Li Y., Liu X. Effect of Emotions on Students Learning Strategies // Proceedings of the 2019 8th International Conference on Educational and Information Technology - ICEIT 2019. 2019.
Tyng C.M. и др. The Influences of Emotion on Learning and Memory // Frontiers in Psychology. 2017. Т. 8.
Pekrun R. Emotions: Functions and Effects on Learning // Encyclopedia of the Sciences of Learning. 2012. С. 1141–1146.
Ramakrishnan S. Recognition of Emotion from Speech: A Review // Speech Enhancement, Modeling and Recognition- Algorithms and Applications. 2012.
Kalaiselvi R., Kavitha P., Shunmuganathan K.L. Automatic emotion recognition in video // 2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE). 2014.
Meyer D.K. Situating Emotions in Classroom Practices // International Handbook of Emotions in Education.
Cohen I. et al. Facial expression recognition from video sequences: temporal and static modeling // Computer Vision and Image Understanding. 2003. Vol. 91, № 1-2. P. 160–187.
Weber, H., Cruz Rodriguez, A., Mateus, A. // Emotion and Mood in Design Thinking.
Zeng H. et al. Emotion Cues: Emotion-Oriented Visual Summarization of Classroom Videos // IEEE Transactions on Visualization and Computer Graphics. 2020. P. 1–1.
Putra W.B., Arifin F. Real-Time Emotion Recognition System to Monitor Student’s Mood in a Classroom // Journal of Physics: Conference Series. 2019. Vol. 1413. P. 012021.
Meeting and phone statistics [Electronic resource] // Zoom Help Center. URL: https://support.zoom.us/hc/en-us/articles/202920719-Meeting-and-phone-statistics.
Zhang K. et al. Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks // IEEE Signal Processing Letters. 2016. Vol. 23, № 10. P. 1499–1503.
Tarasov A.V., Savchenko A.V. Emotion Recognition of a Group of People in Video Analytics Using Deep Off-the-Shelf Image Embeddings // Lecture Notes in Computer Science Analysis of Images, Social Networks and Texts. 2018. P. 191–198.
Colombetti G. From affect programs to dynamical discrete emotions // Philosophical Psychology. 2009. Vol. 22, № 4. P. 407–425.
Ekman P. An argument for basic emotions // Cognition and Emotion. 1992. Vol. 6, № 3-4. P. 169–200.
Russell J.A., Mehrabian A. Evidence for a three-factor theory of emotions // Journal of Research in Personality. 1977. Vol. 11, № 3. P. 273–294.
Sun K. et al. An improved valence-arousal emotion space for video affective content representation and recognition // 2009 IEEE International Conference on Multimedia and Expo. 2009.
Radboud Faces Database [Electronic resource] // Radboud University Nijmegen. URL: http://www.socsci.ru.nl:8180/RaFD2/RaFD.
FER-2013: Wolfram Data Repository [Electronic resource] // FER-2013 | Wolfram Data Repository. URL: https://datarepository.wolframcloud.com/resources/FER-2013.
