A Mobile Food Recognition System for Dietary Assessment


Creative Commons License

Aktı Ş., Qaraqe M., Ekenel H. K.

21st International Conference on Image Analysis and Processing (ICIAP), Lecce, İtalya, 23 - 27 Mayıs 2022, cilt.13373, ss.71-81 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 13373
  • Doi Numarası: 10.1007/978-3-031-13321-3_7
  • Basıldığı Şehir: Lecce
  • Basıldığı Ülke: İtalya
  • Sayfa Sayıları: ss.71-81
  • Anahtar Kelimeler: Food recognition, Assistive technology, Computer vision, FEATURES
  • İstanbul Teknik Üniversitesi Adresli: Evet

Özet

Food recognition is an important task for a variety of applications, including managing health conditions and assisting visually impaired people. Several food recognition studies have focused on generic types of food or specific cuisines, however, food recognition with respect to Middle Eastern cuisines has remained unexplored. Therefore, in this paper we focus on developing a mobile friendly, Middle Eastern cuisine focused food recognition application for assisted living purposes. In order to enable a low-latency, high-accuracy food classification system, we opted to utilize the Mobilenet-v2 deep learning model. As some of the foods are more popular than the others, the number of samples per class in the used Middle Eastern food dataset is relatively imbalanced. To compensate for this problem, data augmentation methods are applied on the underrepresented classes. Experimental results show that using Mobilenet-v2 architecture for this task is beneficial in terms of both accuracy and the memory usage. With the model achieving 94% accuracy on 23 food classes, the developed mobile application has potential to serve the visually impaired in automatic food recognition via images.