How Positional Information Affect Convolutional Neural Networks? Konumsal Bilgi Evrisimsel Sinir Aglarini Nasil Etkiler?


Saritas E., Ekenel H. K.

8th International Conference on Computer Science and Engineering, UBMK 2023, Burdur, Turkey, 13 - 15 September 2023, pp.526-531 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/ubmk59864.2023.10286763
  • City: Burdur
  • Country: Turkey
  • Page Numbers: pp.526-531
  • Keywords: Convolutional Neural Network, Transformers
  • Istanbul Technical University Affiliated: Yes

Abstract

The success of Transformers, including in the field of image processing, has recently attracted the attention of researchers. Some of the researchers tried to design Transformer- based or Convolutional Neural Network-based models separately, while others tried to combine them to produce hybrid models. A significant amount of hybrid model studies have examined the sub-model design and/or the applicability of self-attention in Convolutional Neural Networks. However, position embedding, another contribution from Transformers, has received much less attention. In this study, the effect of position information on Convolutional Neural Networks was analyzed. As a result of the experiments, it has been observed that the use of position information affects performance. In the AgeDB-30, CALFW, and LFW test sets, models with different position information usage have been able to surpass the performance of the model without position information by achieving 95.12%, 93.95%, and 99.52% accuracy, respectively.