Opportunistic RL-based WiFi Access for Aerial Sensor Nodes in Smart City Applications

Ariman M., Cakir L. V., Ozdem M., Canberk B.

2023 International Conference on Smart Applications, Communications and Networking, SmartNets 2023, İstanbul, Turkey, 25 - 27 July 2023 identifier

  • Publication Type: Conference Paper / Full Text
  • Doi Number: 10.1109/smartnets58706.2023.10215658
  • City: İstanbul
  • Country: Turkey
  • Keywords: Ad-Hoc, Deep Q-Learning, Machine Learning, Resource Allocation, Traffic Engineering, UAV Network
  • Istanbul Technical University Affiliated: Yes


Unmanned air vehicles are becoming widespread, driven by improved wireless technologies. However, the WiFi technology used for communication has a highly crowded and unevenly distributed channel occupancy in its spectrum. To overcome this, WiFi resources need to be utilized efficiently. Therefore, this paper proposes the Opportunistic Reinforcement Learning-based WiFi Access scheme, which exploits intermittent channel occupancy to solve the NP-hard channel assignment problem. As a result, the proposed model has improved the accurate channel selection on the UAVs by 9%, performing 91% accuracy, compared to the trivial channel scoring-based selection algorithms.