Emotion Recognition on Static Images Using Deep Transfer Learning and Ensembling

Abanoz H., Çataltepe Z.

26th IEEE Signal Processing and Communications Applications Conference (SIU), İzmir, Türkiye, 2 - 05 Mayıs 2018 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası:
  • Doi Numarası: 10.1109/siu.2018.8404346
  • Basıldığı Şehir: İzmir
  • Basıldığı Ülke: Türkiye
  • İstanbul Teknik Üniversitesi Adresli: Evet

Özet

Emotion recognition may be useful in any area where human and computer interacts. CNNs are known to be good at computer vision tasks. However, CNNs are difficult to train, especially when the amount of data and computation power is limited. Transfer learning emerges as a cheap and efficient way of making use of pre-trained CNN classifiers. Our work has two contributions. Firstly, different CNN architectures and models trained using different datasets are investigated to find a suitable model to use in emotion recognition. Secondly, expert models for each emotion are trained. The Base model is ensembled with expert models to create a better classifier. Experiments show that our use of ensembling together with transfer learning helps to create a good classifier. Final classifier shows 68.32% accuracy on FER13 validation set.