Multi-agent heterogeneous network selection method based on 5G UAV communication

Yu DING; Chenkai LI; Huimei HAN; Weidang LU; Yuanhong REN; Yuan GAO; Jiang CAO

doi:10.11959/j.issn.1000-0801.2022239

您当前的位置：

首页 >

文章列表页 >

Multi-agent heterogeneous network selection method based on 5G UAV communication

Topic: UAV-Assisted Air-Ground Wireless Communication Technology | 更新时间：2024-06-05

- Multi-agent heterogeneous network selection method based on 5G UAV communication
- Telecommunications Science Vol. 38, Issue 8, Pages: 28-36(2022)
- 作者机构：
  
  1. 浙江工业大学信息工程学院，浙江杭州 310023
  2. 北方自动控制技术研究所，山西太原 030006
  3. 中国人民解放军军事科学院，北京 100091
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2022239
  CLC： TN925
- Published Online：2022-08，
  
  Published：20 August 2022
- 稿件说明：
移动端阅览
Yu DING, Chenkai LI, Huimei HAN, et al. Multi-agent heterogeneous network selection method based on 5G UAV communication[J]. Telecommunications science, 2022, 38(8): 28-36.
DOI：

Yu DING, Chenkai LI, Huimei HAN, et al. Multi-agent heterogeneous network selection method based on 5G UAV communication[J]. Telecommunications science, 2022, 38(8): 28-36. DOI： 10.11959/j.issn.1000-0801.2022239.

摘要

摘要：5G无人机通信网络和各种不同无线接入技术的结合使无线异构网络呈现多样化的发展趋势。然而，用户繁多且不同的业务请求对网络要求也不同，造成网络接入选择问题。提出了一种基于5G无人机通信的多智能体异构网络选择方法，将用户分为多个智能体，从用户端和网络端两个方面出发，将用户侧的时延和传输速率需求与网络侧的负载均衡需求综合考虑作为即时回报的相关参数，通过基于Nash Q-Learning的算法进行学习，得到异构网络环境下的网络选择决策模型。仿真结果表明，所提异构网络选择方法针对不同业务类型用户的需求均能选择合适的网络，同时均衡网络的负载，充分利用异构无线网络的资源。

Abstract

The combination of 5G UAV communication and different wireless access technologies makes wireless heterogeneous networks present a diversified development trend.However

various types of service requests by users have different requirements on the heterogeneous networks

which leads to the problem of network selection.A multi-agent heterogeneous network selection method based on 5G UAV communication was proposed.Specifically

the users were divided into multiple agents.From the two aspects of the user side and the network side

the delay and transmission rate requirements of the user side and the load balancing requirement of the network side were comprehensively considered as the relevant parameters of immediate reward.The simulation results show that the proposed heterogeneous network selection method can select the appropriate network according to the needs of users of different service types

balance the load of the network

and make full use of the resources of the heterogeneous wireless network.

关键词

Keywords

references

贺子健 , 艾元 , 闫实 , 等 . 无人机通信网络的容量与覆盖性能 [J ] . 电信科学 , 2017 , 33 ( 10 ): 65 - 70 .

HE Z J , AI Y , YAN S , et al . Performance evaluation of capacity and coverage in UAV communication networks [J ] . Telecommunications Science , 2017 , 33 ( 10 ): 65 - 70 .

LU W D , DING Y , GAO Y , et al . Secure NOMA-based UAV-MEC network towards a flying eavesdropper [J ] . IEEE Transactions on Communications , 2022 , 70 ( 5 ): 3364 - 3376 .

张祖凡 , 张宇 . 基于3D-Markov链的异构网络用户QoE分析方法 [J ] . 中国科学:信息科学 , 2016 , 46 ( 1 ): 85 - 99 .

ZHANG Z F , ZHANG Y . QoE analysis method for heterogeneous network user based on 3D-Markov chain [J ] . Scientia Sinica(Informationis) , 2016 , 46 ( 1 ): 85 - 99 .

刘军 , 李晓楠 . 基于层次分析法的 WLAN/蜂窝网络切换判决算法 [J ] . 通信学报 , 2013 , 34 ( 2 ): 65 - 72 .

LIU J , LI X N . Handover algorithm for WLAN/cellular networks with analytic hierarchy process [J ] . Journal on Communications , 2013 , 34 ( 2 ): 65 - 72 .

盛洁 , 马冬 . 异构无线网络业务接入多目标优化控制算法 [J ] . 电子学报 , 2016 , 44 ( 2 ): 282 - 288 .

SHENG J , MA D . Multi-objective optimal based service access control algorithm for heterogeneous wireless networks [J ] . Acta Electronica Sinica , 2016 , 44 ( 2 ): 282 - 288 .

ZHOU W A , XU Y J , LIANG T , et al . Optimal power allocation for heterogeneous network capacity maximization [J ] . China Communications , 2013 , 10 ( 9 ): 97 - 103 .

CHANG B J , CHEN J F . Cross-layer-based adaptive vertical handoff with predictive RSS in heterogeneous wireless networks [J ] . IEEE Transactions on Vehicular Technology , 2008 , 57 ( 6 ): 3679 - 3692 .

石文孝 , 范绍帅 , 王柟 , 等 . 基于模糊神经网络的异构无线网络接入选择算法 [J ] . 通信学报 , 2010 , 31 ( 9 ): 151 - 156 .

SHI W X , FAN S S , WANG N , et al . Fuzzy neural network based access selection algorithm in heterogeneous wireless networks [J ] . Journal on Communications , 2010 , 31 ( 9 ): 151 - 156 .

MIAO J , HU Z , YANG K , et al . Joint power and bandwidth allocation algorithm with QoS support in heterogeneous wireless networks [J ] . IEEE Communications Letters , 2012 , 16 ( 4 ): 479 - 481 .

CHEN H N , WU H Y , KUMAR S , et al . Minimum-cost data delivery in heterogeneous wireless networks [J ] . IEEE Transactions on Vehicular Technology , 2007 , 56 ( 6 ): 3511 - 3523 .

LIU S M , PAN S , MI Z K , et al . A simple additive weighting vertical handoff algorithm based on SINR and AHP for heterogeneous wireless networks [J ] . 2010 International Conference on Intelligent Computation Technology and Automation , 2010 , 1 : 347 - 350 .

魏淑芝 , 朱琦 . 基于网络选择的视频通信带宽博弈算法 [J ] . 通信学报 , 2015 , 36 ( 2 ): 216 - 224 .

WEI S Z , ZHU Q . Bandwidth allocation games based on network selection for video communication [J ] . Journal on Communications , 2015 , 36 ( 2 ): 216 - 224 .

CHAMODRAKAS I , MARTAKOS D . A utility-based fuzzy TOPSIS method for energy efficient network selection in heterogeneous wireless networks [J ] . Applied Soft Computing , 2011 , 11 ( 4 ): 3734 - 3743 .

GOYAL R K , KAUSHAL S , SANGAIAH A K . The utility based non-linear fuzzy AHP optimization model for network selection in heterogeneous wireless networks [J ] . Applied Soft Computing , 2018 , 67 : 800 - 811 .

赵彦清 , 朱琦 . 基于 Q 学习的异构网络选择新算法 [J ] . 计算机应用 , 2011 , 31 ( 6 ): 1461 - 1464 , 1479 .

ZHAO Y Q , ZHU Q . New Q-learning based heterogeneous network selection algorithm [J ] . Journal of Computer Applications , 2011 , 31 ( 6 ): 1461 - 1464 , 1479 .

XIE J L , GAO W J , LI C R . Heterogeneous network selection optimization algorithm based on a Markov decision model [J ] . China Communications , 2020 , 17 ( 2 ): 40 - 53 .

CHEN J L , YIN M X , DUAN X H , et al . Q-learning based selection strategies for load balance and energy balance in heterogeneous networks [C ] // Proceedings of 2020 5th International Conference on Computer and Communication Systems (ICCCS) . Piscataway:IEEE Press , 2020 : 728 - 732 .

WANG X Q , SU X , LIU B . A novel network selection approach in 5G heterogeneous networks using Q-learning [C ] // Proceedings of 2019 26th International Conference on Telecommunications (ICT) . Piscataway:IEEE Press , 2019 : 309 - 313 .

YANG J , FENG L , JIN T . Enabling sector scheduling for 5G-CPE dense networks [J ] . Security and Communication Networks , 2020 ( 7 ): 1 - 18 .

Views

342

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Architecture design, key technologies, and application research of GPU heterogeneous resource pool platform based on virtualization

Challenges and key technologies of new Ethernet for intelligent computing center

Review on unmanned aerial vehicle covert communication network

FALB: a FC protocol link aggregation algorithm

Outage performance analysis for multi-UAV relay systems with threshold-based DF protocol

Related Author

ZHANG Wenqiang

WANG Tao

YANG Wenqing

ZHANG Nan

ZHANG Wancai

WANG Haojie

WANG Ruixue

LI Han

Related Institution

Nari Technology Development Co., Ltd.

China Mobile Research Institute

School of Mathematics and Information Engineering,Jiaxing University

School of Science, Jiangxi University of Science and Technology

Lenovo Group

⁰