Journal of Graphic Engineering and Design

Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut ero labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco.

GUIDE FOR AUTHORS SUBMIT MANUSCRIPT
Vol. 15 No. 4 (2024): JGED - December 2024
Original scientific paper

Analysis of emotion recognition through 2D micro-animations of an illustrated character's face

Sinja Stres
University of Ljubljana, Faculty of Natural Sciences and Engineering, Department of Textiles, Graphic Arts and Design, Ljubljana, Slovenia
Helena Gabrijelčič Tomc
University of Ljubljana, Faculty of Natural Sciences and Engineering, Department of Textiles, Graphic Arts and Design, Ljubljana, Slovenia

Published 2024-12-01

abstract views: 27 // Full text article (PDF): 25


Keywords

  • 2D animation,
  • micro-animation,
  • displaying emotions,
  • micro-expressions,
  • character design

How to Cite

Stres, S., & Gabrijelčič Tomc, H. (2024). Analysis of emotion recognition through 2D micro-animations of an illustrated character’s face. Journal of Graphic Engineering and Design, 15(4), 29–43. https://doi.org/10.24867/JGED-2024-4-029

Abstract

Emotions make up a large part of everyday communication. Humans learn to recognize emotions by observing others and by referencing their feelings with the emotions of other people. Also, in cartoons, commercials, posts, etc., it's
important that the design of the characters keeps the recognition of emotions high. Expressed emotions provide a better connection between the character and the viewer, making the message more understandable and tangible. This study analyses the recognition of animated facial expressions depicting different emotions on the face of an illustrated character. The accuracy of recognition of six basic emotional expressions (joy, sadness, anger, surprise, fear, and disgust) was compared. Using micro-animation techniques, each emotion was presented in three levels of intensity (a subtle version, a normal version, and an exaggerated version). Emotion recognition was analysed with a method of metric analysis of viewing and surveying that measured recognition time and accuracy in addition to the correctness of the characters' emotion recognition. Statistically relevant differences between the results of animated emotion recognition as a function of recognition time and type of recognition task were examined. The results show how recognition changed as a function of the emotion shown and intensity, and provide a deeper understanding of micro-animations and facial expressions on the animated character's face. Statistically relevant differences were found especially in the recognition of the emotions disgust and anger compared to the recognition of the emotion joy, surprise, fear. Based on the results, guidelines are given to help animators answer the question of which emotions need to be particularly exaggerated to be correctly recognised and which emotions can be animated more subtly without affecting emotional perception.

Article history: Received (August 11, 2023); Revised (December 7, 2023); Accepted (December 21, 2023)

PlumX Metrics

Dimensions Citation Metrics

References

  1. Adegbola, T. (2008) Facial animation and speech synthesis. MSc thesis. DigiPen Institute of Technology.
  2. Babich, N. (2016) How to detect lies : micro expressions. Medium. Available from: https://medium.com/@101/how-to-detect-lies-microexpressions-b17ae1b1181e [Accessed 12th July 2023].
  3. Boucher, J. D. & Ekman, P. (1975) Facial areas and emotional information. Journal of Communication. 25 (2), 21-29. Available from: doi:10.1111/j.1460-2466.1975.tb00577.x
  4. Brosnan, M., Johnson, H., Grawmeyer, B., Chapman, E. & Benton, L. (2015) Emotion recognition in animated compared to human stimuli in adolescents with autism spectrum disorder. National library of Medicine. Available from: doi: 10.1007/s10803-014-2338-9
  5. Eisner, W. (1958) Comics and sequential art: principles and practices from the legendary cartoonist. Tamarac, Florida, Poorhouse press. Available from: https://alphalight.wordpress.com/wp-content/uploads/2010/07/will-eisner-theory-of-comics-sequential-art.pdf [Accessed 12th July 2023].
  6. Ekman, P. (2003) Emotions revealed. New York, Times books: Henry Holt and Company. Available from: https://zscalarts.wordpress.com/wp-content/uploads/2014/01/emotions-revealed-bypaul-ekman1.pdf [Accessed 12th July 2023].
  7. Ekman, P. (1993) Facial expression and emotion. American psychologist. 48 (4), 384-392. Available from: doi: https://www.paulekman.
  8. com/wp-content/uploads/2013/07/Facial-Expression-And-Emotion1.pdf [Accessed 12th July 2023]
  9. Ekman, P. (2022) Micro Expressions. Paul Ekman Group. Available from: https://www.paulekman.com/resources/micro-expressions/ [Accessed 2nd August 2023].
  10. Ekman, P. (2016) What Scientists Who Study Emotion Agree About. Perspectives on Psychological Science. 11 (1), 31-34. Available
  11. from: doi: 10.1177/1745691615596992
  12. Guo, K. & Shaw, H. (2015) Face in profile view reduces perceive facial expression intensity: an eyetracking study. Acta Psychologica. 155, 19-28. Available from: doi: 10.1016/j.actpsy.2014.12.001
  13. Hooks, E. (2015) The illusion of life and acting. Animation salvation. Available from: https://www.animationsalvation.com/the-illusion-of-lifeand-acting/ [Accessed 2nd August 2023].
  14. Hou, T. (2021) Perception of micro-expressions in animated characters with different visual styles. MSc thesis. Purdue University.
  15. Iskra, A. (2020) Development of Combined Method for Analysis of facial Images Using Eye Tracking System - Razvoj kombinirane metode za analizo obraznih slik z uporabo sistema sledenja pogleda. PhD thesis. University of Ljubljana, Faculty of Natural Sciences and Engineering.
  16. Kehr, D. (2023) Animation. Britannica. Available from: https://www.britannica.com/art/animation [Accessed 2nd August 2023].
  17. King, S. (2001) A facial model and animation techniques for animated speech. PhD thesis. The Ohio State University.
  18. Kramer, R. S. S., Youn,. A. W. & Burtona, A. M. (2018) Understanding face familiarity. Cognition. 172, 46-58. Available from: doi: 10.1016/j.cognition.2017.12.005
  19. Lasseter, J. (2001) Tricks to animating characters with a computer. Association for computing machinery. 35 (2), 45-47. Available from: doi: 10.1145/563693.56370
  20. Leyk, D., Sievert, A., Heiss, A., Gorges, W., Ridder, D., Alexander, T., Wunderlich, M. & Ruter, T. (2008) Validation of a short-term memory test for the recognition of people and faces. Ergonomics. 51 (8), 1125-1136. Available from: doi: 10.1080/00140130802094371
  21. Or, C. C. F. & Wilson, H. R. (2010) Face recognition : are viewpoint and indentity processed after face detection?. Vision Research. 50 (16), 1581-1589. Available from: doi: 10.1016/j.visres.2010.05.016
  22. Prajnić, M. (2015) Animacija obraza. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science. Reynolds, J. K. & Przdek, K. (1992) Face recognition memory: the effects of exposure duration and encoding instruction. Applied cognitive psychology. 6 (4), 279-292. Available from: doi: 10.1002/ACP.2350060402
  23. Roberts, S. (2011) Character animation fundamentals: developing skills for 2D and 3D character animation. Amsterdam, Routledge.
  24. Rus, J. (2015) Assigning Human Emotions to fistional 3D characters - Prenos človeških čustev na fikcijske 3D karakterje. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
  25. Strgar, M. (2019) Analysis of Emotion Perception in Portrait Photography - Analiza zaznave čustev v fotografskem portretu. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
  26. Tarnowski, P., Kolidziej, M., Majkovski, A. & Rak, R. J. (2017) Emotion recognition usig facial expressions. Precedia Computer Science. 108, 1175-1184. Available from: doi: 10.1016/j.procs.2017.05.025
  27. Thomas, F. & Johnston, O. (1995) The illusion of life: Disney animation. New York, Walt Disney Productions.
  28. Veler, L. (2018) Consistency of the twelf principles of animation and rendering techniques - Skladnost dvanajstih principov animacije in tehnik uporabljanja. BSc thesis. University of Maribor, Faculty of Electrical Engineering and Computer Science.
  29. Williams, R. (2001) The Animator's Survival Kit. 2nd ed. London, Faber & Faber.
  30. Webster, C. (2005) Animation: The Mechanics of Motion. Amsterdam, Focal Press.
  31. Zhang, S., Liu, X., Yang, X., Shu, Y., Liu, N., Zhang, D., Liu & Y. J. (2021) The Influence of Key Facial Features on Recognition of Emotion in Cartoon Faces. Frontiers in Psychology. 12, 687974. Available from: doi: 10.3389/fpsyg.2021.687974