Recognizing and Tracking Person of Interest: A Real-Time Efficient Deep Learning based Method for Quadcopters


Dursun H. E., Guven E. C., Avci B., Kumbasar T.

10th International Conference on Recent Advances in Air and Space Technologies, RAST 2023, İstanbul, Turkey, 7 - 09 June 2023 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/rast57548.2023.10197971
  • City: İstanbul
  • Country: Turkey
  • Keywords: classification, deep learning, distributed system, quadcopters, real-time, tracking
  • Istanbul Technical University Affiliated: Yes

Abstract

The recognition and tracking of a person of interest is a crucial task in many applications, including search and rescue, security, and surveillance. This paper presents a distributed system architecture that leverages the asynchronous threading and communication property of ROS2 to develop and implement a real-time efficient Deep Learning (DL) based method for recognizing and tracking a person of interest. The DL model receives snapshots from the quadcopter's camera and sends back an information vector, which includes all recognized persons and their corresponding position information within the camera frame of the quadcopter. The person of interest tracking control system receives face set information about the person of interest and generates reference velocity signals to be tracked by low-level controllers embedded within the drone. Experiments conducted in a cluttered and complex environment demonstrate the efficiency of the DL-based architecture for quadcopters. The presented real- world results validate the effectiveness of the proposed approach in recognizing and tracking a person of interest. The experimental video is available at https://youtu.be/i7bYXnRy8Vc.