一种基于深度强化学习的海上MEC任务卸载和资源分配优化算法

徐艳丽; 周子睿

doi:10.11959/j.issn.1000-0801.2025227

您当前的位置：

首页 >

文章列表页 >

一种基于深度强化学习的海上MEC任务卸载和资源分配优化算法

专题：水下通信网络技术 | 更新时间：2025-11-06

- 一种基于深度强化学习的海上MEC任务卸载和资源分配优化算法
- An optimization algorithm based on deep reinforcement learning for maritime MEC task offloading and resource allocation
- 电信科学 2025年41卷第10期页码：102-121
- 作者机构：
  
  上海海事大学信息工程学院，上海 201306
- 作者简介：
  
  [ "徐艳丽（1984- ），女，上海海事大学信息工程学院副院长、教授、博士生导师，主要研究方向为海事通信、边缘计算和自动驾驶等。" ]
  [ "周子睿（2001- ），男，上海海事大学信息工程学院硕士生，主要研究方向为海事通信和边缘计算。" ]
- 基金信息：
  
  国家自然科学基金资助项目(62271303);上海教委科研创新计划自然科学重大项目;The Innovation Program of Shanghai Municipal Education Commission of China(2021-01-07-00-10-E00121);上海市自然科学基金资助项目(20ZR1423200)
- DOI：10.11959/j.issn.1000-0801.2025227
  中图分类号： TP393;TN92
- 收稿：2025-06-30，
  
  修回：2025-09-25，
  
  录用：2025-09-28，
  
  纸质出版：2025-10-20
- 稿件说明：
移动端阅览
徐艳丽,周子睿.一种基于深度强化学习的海上MEC任务卸载和资源分配优化算法[J].电信科学,2025,41(10):102-121.

XU Yanli,ZHOU Zirui.An optimization algorithm based on deep reinforcement learning for maritime MEC task offloading and resource allocation[J].Telecommunications Science,2025,41(10):102-121.
徐艳丽,周子睿.一种基于深度强化学习的海上MEC任务卸载和资源分配优化算法[J].电信科学,2025,41(10):102-121. DOI： 10.11959/j.issn.1000-0801.2025227.

XU Yanli,ZHOU Zirui.An optimization algorithm based on deep reinforcement learning for maritime MEC task offloading and resource allocation[J].Telecommunications Science,2025,41(10):102-121. DOI： 10.11959/j.issn.1000-0801.2025227.

摘要

移动边缘计算被认为是减少回程压力和提高服务质量的重要解决方案，但现有的资源管理策略在高动态的海洋环境下适应性较差。为解决该问题，提出了一种基于改进双延迟深度确定性策略梯度的任务卸载和资源分配算法。该算法可系统地协调无人机部署与边缘节点资源，联合优化通信资源分配和计算任务调度，同时考虑海洋边缘节点的能量限制和海洋网络的时变特性。具体而言，问题被表述为一个非凸优化框架，目标是在用户设备严格的服务质量要求下最大化吞吐量。提出的算法通过资源协调动态适应海洋环境变化，有效平衡了时延和能耗。仿真结果表明，在高动态的海事通信场景中，提出的算法显著优于现有的基准方法，证明该方法的有效性和可行性。

Abstract

Mobile edge computing is considered as an important solution to reduce backhaul pressure and improve quality of service

yet existing resource management strategies are poorly adapted in highly dynamic ocean environments. To address this problem

a task offloading and resource allocation algorithm based on an improved twin-delayed deep deterministic policy gradient was proposed. The algorithm was designed to systematically coordinate servo UAV deployment with edge node resources to jointly optimize communication resource allocation and computational task scheduling

while taking into account the energy constraints of ocean edge nodes and the time-varying characteristics of ocean networks. Specifically

the problem was formulated as a non-convex optimization framework with the objective of maximizing throughput under stringent quality of service requirements of user devices. The proposed algorithm dynamically adapted to the changing ocean environment through resource coordination

effectively balancing delay and energy consumption. Simulation results show that the proposed algorithm significantly outperforms existing benchmark methods in highly dynamic maritime communication scenarios

demonstrating the effectiveness and feasibility of the approach.

关键词

Keywords

references

LIU S L , ZHU L J , HUANG F H , et al . A survey on air-to-sea integrated maritime Internet of Things: enabling technologies, applications, and future challenges [J ] . Journal of Marine Science and Engineering , 2024 , 12 ( 1 ): 11 .

AKHTAR M W , SAEED N . UAVs-enabled maritime communications: UAVs-enabled maritime communications: opportunities and challenges [J ] . IEEE Systems, Man, and Cybernetics Magazine , 2023 , 9 ( 3 ): 2 - 8 .

SHIRIN ABKENAR F , RAMEZANI P , IRANMANESH S , et al . A survey on mobility of edge computing networks in IoT: state-of-the-art, architectures, and challenges [J ] . IEEE Communications Surveys & Tutorials , 2022 , 24 ( 4 ): 2329 - 2365 .

QIN Z , HE S S , WANG H , et al . Air-ground collaborative mobile edge computing: Architecture, challenges, and opportunities [J ] . China Communications , 2024 , 21 ( 5 ): 1 - 16 .

QIU Y , NIU J W , ZHU X Z , et al . Mobile edge computing in space-air-ground integrated networks: architectures, key technologies and challenges [J ] . Journal of Sensor and Actuator Networks , 2022 , 11 ( 4 ): 57 .

NING Z L , HU H , WANG X J , et al . Mobile edge computing and machine learning in the Internet of unmanned aerial vehicles: a survey [J ] . ACM Computing Surveys , 2024 , 56 ( 1 ): 1 - 31 .

SHARMA A , DIWAKER C , NADIYAN M . Analysis of offloading computation in mobile edge computing (MEC): a survey [C ] // Proceedings of the 2022 Seventh International Conference on Parallel, Distributed and Grid Computing (PDGC) . Piscataway : IEEE Press , 2022 : 280 - 285 .

DJIGAL H , XU J , LIU L F , et al . Machine and deep learning for resource allocation in multi-access edge computing: a survey [J ] . IEEE Communications Surveys & Tutorials , 2022 , 24 ( 4 ): 2449 - 2494 .

ADIL M , SONG H B , MASTORAKIS S , et al . UAV-assisted IoT applications, cybersecurity threats, AI-enabled solutions, open challenges with future research directions [J ] . IEEE Transactions on Intelligent Vehicles , 2024 , 9 ( 4 ): 4583 - 4605 .

ZHANG P Y , WANG C , JIANG C X , et al . UAV-assisted multi-access edge computing: technologies and challenges [J ] . IEEE Internet of Things Magazine , 2021 , 4 ( 4 ): 12 - 17 .

LIU Z W , CAO Y , GAO P , et al . Multi-UAV network assisted intelligent edge computing: challenges and opportunities [J ] . China Communications , 2022 , 19 ( 3 ): 258 - 278 .

NOMIKOS N , GKONIS P K , BITHAS P S , et al . A survey on UAV-aided maritime communications: deployment considerations, applications, and future challenges [J ] . IEEE Open Journal of the Communications Society , 2022 ( 4 ): 56 - 78 .

KIM M , JANG J , CHOI Y , et al . Distributed task offloading and resource allocation for latency minimization in mobile edge computing networks [J ] . IEEE Transactions on Mobile Computing , 2024 , 23 ( 12 ): 15149 - 15166 .

QIAN L P , SHI B H , WU Y , et al . NOMA-enabled mobile edge computing for Internet of Things via joint communication and computation resource allocations [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 1 ): 718 - 733 .

WANG Y , TAO X F , HOU Y T , et al . Effective capacity-based resource allocation in mobile edge computing with two-stage tandem queues [J ] . IEEE Transactions on Communications , 2019 , 67 ( 9 ): 6221 - 6233 .

XING H , LIU L , XU J , et al . Joint task assignment and resource allocation for D2D-enabled mobile-edge computing [J ] . IEEE Transactions on Communications , 2019 , 67 ( 6 ): 4193 - 4207 .

TUN Y K , DANG T N , KIM K , et al . Collaboration in the sky: a distributed framework for task offloading and resource allocation in multi-access edge computing [J ] . IEEE Internet of Things Journal , 2022 , 9 ( 23 ): 24221 - 24235 .

EI N N , YOON J S , HONG C S . Energy-aware task offloading and resource allocation in space-aerial-integrated MEC system [C ] // Proceedings of the 2022 23rd Asia-Pacific Network Operations and Management Symposium (APNOMS) . Piscataway : IEEE Press , 2022 : 1 - 6 .

AN X M , FAN R F , HU H , et al . Joint task offloading and resource allocation for IoT edge computing with sequential task dependency [J ] . IEEE Internet of Things Journal , 2022 , 9 ( 17 ): 16546 - 16561 .

WU J , JIA M , GUO Q , et al . Joint optimization computation offloading and resource allocation for LEO satellite with edge computing [C ] // Proceedings of the 2023 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) . Piscataway : IEEE Press , 2023 : 1 - 5 .

GUO F X , YU F R , ZHANG H L , et al . Adaptive resource allocation in future wireless networks with blockchain and mobile edge computing [J ] . IEEE Transactions on Wireless Communications , 2019 , 19 ( 3 ): 1689 - 1703 .

NATH S , WU J X . Deep reinforcement learning for dynamic computation offloading and resource allocation in cache-assisted mobile edge computing systems [J ] . Intelligent and Converged Networks , 2020 , 1 ( 2 ): 181 - 198 .

LIANG Y , SUN H F . Optimizing task processing efficiency in MEC networks through cooperative offloading and resource allocation [C ] // Proceedings of the 2024 6th International Conference on Communications, Information System and Computer Engineering (CISCE) . Piscataway : IEEE Press , 2024 : 296 - 301 .

WEI Z , HE R X , LI Y N . Deep reinforcement learning based task offloading and resource allocation for MEC-enabled IoT networks [C ] // Proceedings of the 2023 IEEE/CIC International Conference on Communications in China (ICCC Workshops) . Piscataway : IEEE Press , 2023 : 1 - 6 .

YU L , JIANG S R , ZHENG J , et al . A DQN-based joint computing offloading and resource allocation algorithm for MEC networks [C ] // Proceedings of the ICC 2023 - IEEE International Conference on Communications . Piscataway : IEEE Press , 2023 : 2553 - 2558 .

ZHANG B Y , JIANG Y X , HUANG Y G , et al . A DRL scheme for resource allocation in the MEC-empowered CF-mMIMO system [C ] // Proceedings of the 2023 IEEE 23rd International Conference on Communication Technology (ICCT) . Piscataway : IEEE Press , 2023 : 495 - 500 .

HAZARIKA B , SINGH K , BISWAS S , et al . DRL-based resource allocation for computation offloading in IoV networks [J ] . IEEE Transactions on Industrial Informatics , 2022 , 18 ( 11 ): 8027 - 8038 .

LIU Y , YU H M , XIE S L , et al . Deep reinforcement learning for offloading and resource allocation in vehicle edge computing and networks [J ] . IEEE Transactions on Vehicular Technology , 2019 , 68 ( 11 ): 11158 - 11168 .

Kingman J F C . The single server queue in heavy traffic [C ] // Mathematical Proceedings of the Cambridge Philosophical Society . Cambridge University Press , 1961 , 57 ( 4 ): 902 - 904 .

浏览量

482

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于边-端协同的任务卸载资源分配联合优化算法

面向差异化QoE基于匹配理论的任务卸载与资源分配方案

移动边缘计算中资源分配和定价方法综述

基于NOMA的超密集MEC网络任务卸载和资源分配方案

一种面向资源高效利用的无蜂窝RAN分层协同资源分配算法