Real Time Animated Facial Expression Transfer

Ekmen B., Ekenel H. K.

24th Signal Processing and Communication Application Conference (SIU), Zonguldak, Turkey, 16 - 19 May 2016, pp.1193-1196 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume:
  • Doi Number: 10.1109/siu.2016.7495959
  • City: Zonguldak
  • Country: Turkey
  • Page Numbers: pp.1193-1196
  • Istanbul Technical University Affiliated: Yes


Realistic animation of an expressive human face has been a great challenge in computer graphics due to the human perception of human faces. It is a complex, costly and time-consuming process requiring a great detail in many aspects. In this paper, a three-stage method is presented that simplifies the creation of realistic facial animations by transferring the expressions from 2D videos onto 3D models with a joint-based system on a real-time basis. The first stage covers the preparation of the model with a joint-based rig for the transfer. The second includes the real time tracking of a human face with a single camera to obtain 2D positions of facial landmarks. Also it covers the transfer of 3D relative movement data to animate the prepared model by moving the respective joints. The last stage covers the recording of animation using a partially automated key-framing technique. The presented method provides a fast, easy to use and affordable system that produces visually satisfying facial animations.