Sievenet: An Efficient Model Utilizing H.265 Codec Structure for Video Object Detection


Koyun O. C., Töreyin B. U.

2023 IEEE International Conference on Acoustics, Speech and Signal Processing Workshops, ICASSPW 2023, Rhodes Island, Greece, 4 - 10 June 2023 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/icasspw59220.2023.10193722
  • City: Rhodes Island
  • Country: Greece
  • Keywords: Compressed Domain Video Analysis, Deep learning, H.265, HEVC, Video Object Detection
  • Istanbul Technical University Affiliated: Yes

Abstract

In the field of video content analysis, object detection is a crucial task. The High Efficient Video Coding (H.265, HEVC) standard's coding structures are strongly correlated with the video content, creating an opportunity to utilize these structures for video object detection in a computationally efficient way. To address this, we present a video object detection method that partitions frames into macroblocks based on the H.265 structure. Blocks with spatially high-frequency content go through a dynamic-layer approach that subjects them to deeper analysis with more layers, while blocks with spatially low-frequency content undergo fewer layers to enable a lower computational load. Results on ImageNet-Vid Dataset indicate that our approach has the potential to save significant computational resources while maintaining accurate object detection performance.