Deep Reinforcement Learning for Dynamic Band Switch in Cellular-Connected UAV

Files in This Item:
 File SizeFormat
DownloadVTC_Fall_DQNUAVBandswitch.pdf312.55 kBAdobe PDF
Title: Deep Reinforcement Learning for Dynamic Band Switch in Cellular-Connected UAV
Authors: Fontanesi, GianlucaZhu, AndingAhmadi, Hamed
Permanent link:
Date: 30-Sep-2021
Online since: 2022-03-02T10:01:56Z
Abstract: The choice of the transmitting frequency to provide cellular-connected Unmanned Aerial Vehicle (UAV) reliable connectivity and mobility support introduce several challenges. Conventional sub-6 GHz networks are optimized for ground Users (UEs). Operating at the millimeter Wave (mmWave) band would provide high-capacity but highly intermittent links. To reach the destination while minimizing a weighted function of traveling time and number of radio failures, we propose in this paper a UAV joint trajectory and band switch approach. By leveraging Double Deep Q-Learning we develop two different approaches to learn a trajectory besides managing the band switch. A first blind approach switches the band along the trajectory anytime the UAV-UE throughput is below a predefined threshold. In addition, we propose a smart approach for simultaneous learning-based path planning of UAV and band switch. The two approaches are compared with an optimal band switch strategy in terms of radio failure and band switches for different thresholds. Results reveal that the smart approach is able in a high threshold regime to reduce the number of radio failures and band switches while reaching the desired destination.
Funding Details: Irish Research Council
Science Foundation Ireland
Type of material: Conference Publication
Publisher: IEEE
Copyright (published version): 2021 IEEE
Keywords: Vehicular and wireless technologiesReinforcement learningAutonomous aerial vehiclesThroughputTrajectory
DOI: 10.1109/VTC2021-Fall52928.2021.9625502
Other versions:
Language: en
Status of Item: Peer reviewed
Is part of: 2021 IEEE 94th Vehicular Technology Conference (VTC2021-Fall)
Conference Details: The 2021 IEEE 94th Vehicular Technology Conference (VTC2021-Fall), Virtual Event, 27-30 September 2021
ISBN: 9781665413688
ISSN: 1550-2252
This item is made available under a Creative Commons License:
Appears in Collections:Electrical and Electronic Engineering Research Collection

Show full item record

Page view(s)

Last Week
Last month
checked on Sep 28, 2022


checked on Sep 28, 2022

Google ScholarTM



If you are a publisher or author and have copyright concerns for any item, please email and the item will be withdrawn immediately. The author or person responsible for depositing the article will be contacted within one business day.