Analysis of emotion recognition through 2D micro-animations of an illustrated character's face
Published 2024-12-01
abstract views: 27 // Full text article (PDF): 25
Keywords
- 2D animation,
- micro-animation,
- displaying emotions,
- micro-expressions,
- character design
How to Cite
Copyright (c) 2024 © 2024 Authors. Published by the University of Novi Sad, Faculty of Technical Sciences, Department of Graphic Engineering and Design. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license 3.0 Serbia (http://creativecommons.org/licenses/by/3.0/rs/).
This work is licensed under a Creative Commons Attribution 3.0 Unported License.
Abstract
Emotions make up a large part of everyday communication. Humans learn to recognize emotions by observing others and by referencing their feelings with the emotions of other people. Also, in cartoons, commercials, posts, etc., it's
important that the design of the characters keeps the recognition of emotions high. Expressed emotions provide a better connection between the character and the viewer, making the message more understandable and tangible. This study analyses the recognition of animated facial expressions depicting different emotions on the face of an illustrated character. The accuracy of recognition of six basic emotional expressions (joy, sadness, anger, surprise, fear, and disgust) was compared. Using micro-animation techniques, each emotion was presented in three levels of intensity (a subtle version, a normal version, and an exaggerated version). Emotion recognition was analysed with a method of metric analysis of viewing and surveying that measured recognition time and accuracy in addition to the correctness of the characters' emotion recognition. Statistically relevant differences between the results of animated emotion recognition as a function of recognition time and type of recognition task were examined. The results show how recognition changed as a function of the emotion shown and intensity, and provide a deeper understanding of micro-animations and facial expressions on the animated character's face. Statistically relevant differences were found especially in the recognition of the emotions disgust and anger compared to the recognition of the emotion joy, surprise, fear. Based on the results, guidelines are given to help animators answer the question of which emotions need to be particularly exaggerated to be correctly recognised and which emotions can be animated more subtly without affecting emotional perception.
Article history: Received (August 11, 2023); Revised (December 7, 2023); Accepted (December 21, 2023)
Dimensions Citation Metrics
References
- Adegbola, T. (2008) Facial animation and speech synthesis. MSc thesis. DigiPen Institute of Technology.
- Babich, N. (2016) How to detect lies : micro expressions. Medium. Available from: https://medium.com/@101/how-to-detect-lies-microexpressions-b17ae1b1181e [Accessed 12th July 2023].
- Boucher, J. D. & Ekman, P. (1975) Facial areas and emotional information. Journal of Communication. 25 (2), 21-29. Available from: doi:10.1111/j.1460-2466.1975.tb00577.x
- Brosnan, M., Johnson, H., Grawmeyer, B., Chapman, E. & Benton, L. (2015) Emotion recognition in animated compared to human stimuli in adolescents with autism spectrum disorder. National library of Medicine. Available from: doi: 10.1007/s10803-014-2338-9
- Eisner, W. (1958) Comics and sequential art: principles and practices from the legendary cartoonist. Tamarac, Florida, Poorhouse press. Available from: https://alphalight.wordpress.com/wp-content/uploads/2010/07/will-eisner-theory-of-comics-sequential-art.pdf [Accessed 12th July 2023].
- Ekman, P. (2003) Emotions revealed. New York, Times books: Henry Holt and Company. Available from: https://zscalarts.wordpress.com/wp-content/uploads/2014/01/emotions-revealed-bypaul-ekman1.pdf [Accessed 12th July 2023].
- Ekman, P. (1993) Facial expression and emotion. American psychologist. 48 (4), 384-392. Available from: doi: https://www.paulekman.
- com/wp-content/uploads/2013/07/Facial-Expression-And-Emotion1.pdf [Accessed 12th July 2023]
- Ekman, P. (2022) Micro Expressions. Paul Ekman Group. Available from: https://www.paulekman.com/resources/micro-expressions/ [Accessed 2nd August 2023].
- Ekman, P. (2016) What Scientists Who Study Emotion Agree About. Perspectives on Psychological Science. 11 (1), 31-34. Available
- from: doi: 10.1177/1745691615596992
- Guo, K. & Shaw, H. (2015) Face in profile view reduces perceive facial expression intensity: an eyetracking study. Acta Psychologica. 155, 19-28. Available from: doi: 10.1016/j.actpsy.2014.12.001
- Hooks, E. (2015) The illusion of life and acting. Animation salvation. Available from: https://www.animationsalvation.com/the-illusion-of-lifeand-acting/ [Accessed 2nd August 2023].
- Hou, T. (2021) Perception of micro-expressions in animated characters with different visual styles. MSc thesis. Purdue University.
- Iskra, A. (2020) Development of Combined Method for Analysis of facial Images Using Eye Tracking System - Razvoj kombinirane metode za analizo obraznih slik z uporabo sistema sledenja pogleda. PhD thesis. University of Ljubljana, Faculty of Natural Sciences and Engineering.
- Kehr, D. (2023) Animation. Britannica. Available from: https://www.britannica.com/art/animation [Accessed 2nd August 2023].
- King, S. (2001) A facial model and animation techniques for animated speech. PhD thesis. The Ohio State University.
- Kramer, R. S. S., Youn,. A. W. & Burtona, A. M. (2018) Understanding face familiarity. Cognition. 172, 46-58. Available from: doi: 10.1016/j.cognition.2017.12.005
- Lasseter, J. (2001) Tricks to animating characters with a computer. Association for computing machinery. 35 (2), 45-47. Available from: doi: 10.1145/563693.56370
- Leyk, D., Sievert, A., Heiss, A., Gorges, W., Ridder, D., Alexander, T., Wunderlich, M. & Ruter, T. (2008) Validation of a short-term memory test for the recognition of people and faces. Ergonomics. 51 (8), 1125-1136. Available from: doi: 10.1080/00140130802094371
- Or, C. C. F. & Wilson, H. R. (2010) Face recognition : are viewpoint and indentity processed after face detection?. Vision Research. 50 (16), 1581-1589. Available from: doi: 10.1016/j.visres.2010.05.016
- Prajnić, M. (2015) Animacija obraza. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science. Reynolds, J. K. & Przdek, K. (1992) Face recognition memory: the effects of exposure duration and encoding instruction. Applied cognitive psychology. 6 (4), 279-292. Available from: doi: 10.1002/ACP.2350060402
- Roberts, S. (2011) Character animation fundamentals: developing skills for 2D and 3D character animation. Amsterdam, Routledge.
- Rus, J. (2015) Assigning Human Emotions to fistional 3D characters - Prenos človeških čustev na fikcijske 3D karakterje. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
- Strgar, M. (2019) Analysis of Emotion Perception in Portrait Photography - Analiza zaznave čustev v fotografskem portretu. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
- Tarnowski, P., Kolidziej, M., Majkovski, A. & Rak, R. J. (2017) Emotion recognition usig facial expressions. Precedia Computer Science. 108, 1175-1184. Available from: doi: 10.1016/j.procs.2017.05.025
- Thomas, F. & Johnston, O. (1995) The illusion of life: Disney animation. New York, Walt Disney Productions.
- Veler, L. (2018) Consistency of the twelf principles of animation and rendering techniques - Skladnost dvanajstih principov animacije in tehnik uporabljanja. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
- Williams, R. (2001) The Animator's Survival Kit. 2nd ed. London, Faber & Faber.
- Webster, C. (2005) Animation: The Mechanics of Motion. Amsterdam, Focal Press.
- Zhang, S., Liu, X., Yang, X., Shu, Y., Liu, N., Zhang, D., Liu & Y. J. (2021) The Influence of Key Facial Features on Recognition of Emotion in Cartoon Faces. Frontiers in Psychology. 12, 687974. Available from: doi: 10.3389/fpsyg.2021.687974