Deterministic network needs to ensure the deterministic transmission requirements of different applications in terms of delay
packet loss rate
jitter
throughput
and reliability.In response to the differentiated and deterministic network transmission requirements of applications
an on-demand intelligent routing framework OdR for deterministic network was proposed.Under the OdR framework
an on-demand intelligent routing algorithm named OdR-TD3 based on deep reinforcement learning was proposed
which generates routing strategies based on the deterministic QoS requirements of application traffic
to satisfy the applications’ requirements of deterministic network.The experimental evaluation results show the OdR-TD3 algorithm has a significant advantage over the DV algorithm and the SPF algorithm in terms of the achievement rate of deterministic QoS requirements.
关键词
Keywords
references
KARAKUS M , DURRESI A . Quality of service (QoS) in software defined networking (SDN):a survey [J ] . Journal of Network and Computer Applications , 2017 ( 80 ): 200 - 218 .
LI J M , ZHANG N . Deterministic network model with randomness [J ] . Complex Systems and Complexity Science , 2007 , 4 ( 2 ): 56 - 61 .
LUONG N C , HOANG D T , GONG S M , et al . Applications of deep reinforcement learning in communications and networking:a survey [J ] . IEEE Communications Surveys & Tutorials , 2019 , 21 ( 4 ): 3133 - 3174 .
ROBINSON Y H , JULIE E G , SARAVANAN K , et al . FD-AOMDV:fault-tolerant disjoint ad-hoc on-demand multipath distance vector routing algorithm in mobile ad-hoc networks [J ] . Journal of Ambient Intelligence and Humanized Computing , 2019 , 10 ( 11 ): 4455 - 4472 .
WANG Z , CROWCROFT J . Analysis of shortest-path routing algorithms in a dynamic network environment [J ] . ACM SIGCOMM Computer Communication Review , 1992 , 22 ( 2 ): 63 - 71 .
DAI B , CAO Y Y , WU Z L , et al . Routing optimization meets machine intelligence:a perspective for the future network [J ] . Neurocomputing , 2021 , 459 : 44 - 58 .
XIE J F , YU F R , HUANG T , et al . A survey of machine learning techniques applied to software defined networking (SDN):research issues and challenges [J ] . IEEE Communications Surveys & Tutorials , 2019 , 21 ( 1 ): 393 - 430 .
MCKEOWNN , ANDERSONT , BALAKRISHNANH , et al . OpenFlow [J ] . ACM SIGCOMM Computer Communication Review , 2008 , 38 ( 2 ): 69 - 74 .
SCOTT F , HERKE H , DAVID M . Addressing function approximation error in actor-critic methods [C ] // Proceedings of the 35th International Conference on Machine Learning .[S.l.:s.n. ] , 2018 : 1587 - 1596 .
UHLIG S , QUOITIN B , LEPROPRE J , et al . Providing public intradomain traffic matrices to the research community [J ] . ACM SIGCOMM Computer Communication Review , 2006 , 36 ( 1 ): 83 - 86 .