边云协同驱动的沉浸式Web3D

许娅男; 赵桂丹; 冯大权; 施文哲; 陆平

doi:10.11959/j.issn.1000-0801.2024193

您当前的位置：

首页 >

文章列表页 >

边云协同驱动的沉浸式Web3D

研究与开发 | 更新时间：2024-11-25

- 边云协同驱动的沉浸式Web3D
- Edge-cloud collaboration empowered immersive Web3D
- 电信科学 2024年40卷第9期页码：123-135
- 作者机构：
  
  1.深圳大学电子与信息工程学院，广东深圳 518060
  2.重庆信息通信研究院，重庆 401336
  3.移动网络和移动多媒体技术国家重点实验室，广东深圳 518055
  4.广东省哲学社会科学重点实验室（文化数字化与文化创新发展），广东深圳 518060
  5.中兴通讯股份有限公司，广东深圳 518052
- 作者简介：
  
  [ "许娅男（1996- ），女，深圳大学电子与信息工程学院博士生，主要研究方向为沉浸式通信、边缘计算。" ]
  [ "赵桂丹（1993- ），女，重庆信息通信研究院无线部技术应用研究室主任，主要研究方向为无线电频谱技术。" ]
  [ "冯大权（1986- ），男，博士，深圳大学电子与信息工程学院副教授、博士生导师，广东省哲学社会科学重点实验室（文化数字化与文化创新发展）副主任，主要研究方向为沉浸式通信、VA/AR、频谱共享技术。" ]
  [ "施文哲（1989- ），男，移动网络和移动多媒技术国家重点实验室高级工程师，中兴通讯股份有限公司XRExplore产品规划经理，主要研究方向为室内视觉AR导航、三维重建、实时云渲染。" ]
  [ "陆平（1971- ），男，博士，移动网络和移动多媒体技术国家重点实验室副主任，中兴通讯股份有限公司副总裁、正高级工程师，主要研究方向为云计算、增强现实、媒体大数据。" ]
- 基金信息：
  
  国家自然科学基金优秀青年基金项目(62422112);国家重点研发计划项目(2023YFF0612400);深圳市科技计划项目(KJZD20230923114707016)
- DOI：10.11959/j.issn.1000-0801.2024193
  中图分类号： TP393
- 收稿日期：2024-06-03，
  
  修回日期：2024-07-17，
  
  纸质出版日期：2024-09-20
- 稿件说明：
移动端阅览
许娅男,赵桂丹,冯大权等.边云协同驱动的沉浸式Web3D[J].电信科学,2024,40(09):123-135.

XU Yanan,ZHAO Guidan,FENG Daquan,et al.Edge-cloud collaboration empowered immersive Web3D[J].Telecommunications Science,2024,40(09):123-135.
许娅男,赵桂丹,冯大权等.边云协同驱动的沉浸式Web3D[J].电信科学,2024,40(09):123-135. DOI： 10.11959/j.issn.1000-0801.2024193.

XU Yanan,ZHAO Guidan,FENG Daquan,et al.Edge-cloud collaboration empowered immersive Web3D[J].Telecommunications Science,2024,40(09):123-135. DOI： 10.11959/j.issn.1000-0801.2024193.

摘要

以浏览器为载体，Web3D凭借其天然的跨平台、易访问优势，在虚拟现实、3D建模与可视化等数字内容领域展现广泛的应用前景。然而，研究如何构建多元、共享的沉浸式Web3D服务平台尚处于起步阶段。在应对网络环境动态变化、浏览器端渲染性能的限制及未来海量交互需求方面，如何确保无缝通信、计算和存储服务成为核心挑战。随着移动互联网、5G通信等前沿技术的推进以及边缘计算的兴起，Web3D服务模式正逐步从单一的终端或云端渲染方式过渡到边云协作方式，通过有效整合云端、边缘节点和终端用户资源来满足快速响应、数据速传、实时交互需求。围绕边云协同框架在沉浸式Web3D服务中的应用，探讨这一计算模式如何应对Web3D平台搭建中的复杂难题。首先，分析了面向Web3D应用场景的边云协同框架，以及边云协同在构建沉浸式Web3D服务平台时面临的关键挑战。其次，分别从资源调度、传输与加载策略、预缓存机制，以及模型轻量化的角度详细讨论了Web3D边云协同优化方案。最后，探讨了开放性研究问题。

Abstract

Leveraging the natural cross-platform accessibility

Web3D has shown wide application prospects in digital content fields with a browser as a carrier

including virtual reality

3D modeling and visualization

to name a few. Nonetheless

constructing a diversified and shared immersive Web3D service platform is still in its infancy. How to ensure seamless communication

computing

and storage services has become a core challenge in dealing with the dynamic changes in network environments

limitations in browser-based rendering capabilities

and the impending surge in interactive demands. The progression of cutting-edge technologies such as mobile Internet and 5G networks

coupled with the emergence of edge computing

has propelled Web3D service modes from solitary terminal or cloud-based rendering toward a collaborative edge-cloud paradigm. Such a paradigm effectively integrates the resources from the remote cloud

edge nodes

and end users

thereby fulfilling the requirements of rapid response

high-speed data transmission

and real-time interaction. Focusing on the application of edge-cloud collaboration frameworks in immersive Web3D services

how this computing mode tackle the intricate issues encountered in establishing Web3D platforms was discussed. Firstly

a Web3D scenario-oriented edge-cloud collaboration framework and the key challenges faced in constructing immersive Web3D service platforms were discussed. Secondly

the optimization strategies for edge-cloud collaboration-driven Web3D were discussed from the perspectives of resource scheduling

transmission and loading

pre-caching schemes

and model lightweighting

respectively. Finally

open research questions were explored.

关键词

Keywords

references

SEHNAL D , BITTRICH S , DESHPANDE M , et al . Mol* Viewer: modern Web App for 3D visualization and analysis of large biomolecular structures [J ] . Nucleic Acids Research , 2021 , 49 ( W1 ): W431 - W437 .

YU G , LIU C , FANG T , et al . A survey of real-time rendering on Web3D application [J ] . Virtual Reality & Intelligent Hardware , 2023 , 5 ( 5 ): 379 - 394 .

LI K , ZHANG Q , ZHAO H T , et al . User interests driven collaborative cloud-edge-browser architecture for WebBIM visualization [C ] // Proceedings of the 25th International Conference on 3D Web Technology . New York : ACM Press , 2020 : Article 8 .

FLECK P , SCHMALSTIEG D , ARTH C . Creating IoT-ready XR-WebApps with Unity3 D[C ] // Proceedings of the 25th International Conference on 3D Web Technology . New York : ACM Press , 2020 : Article 1 .

MACLNTYRE B , SMITH T F . Thoughts on the future of WebXR and the immersive Web [C ] // Proceedings of 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) . Piscataway : IEEE Press , 2018 : 338 - 342 .

LIU Q , HUANG S Q , OPADERE J , et al . An edge network orchestrator for mobile augmented reality [C ] // Proceedings of IEEE INFOCOM 2018 - IEEE Conference on Computer Communications . Piscataway : IEEE Press , 2018 : 756 - 764 .

ZHOU Y , LIU L , WANG L , et al . Service-aware 6G: an intelligent and open network based on the convergence of communication, computing and caching [J ] . Digital Communications and Networks , 2020 , 6 ( 3 ): 253 - 260 .

CAI Q , ZHOU Y Q , LIU L , et al . Collaboration of heterogeneous edge computing paradigms: how to fill the gap between theory and practice [J ] . IEEE Wireless Communications , 2024 , 31 ( 1 ): 110 - 117 .

CAO J , LAM K Y , LEE L-H . Demo: real-time WebXR edge-based object detection for AR [C ] // Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services . New York : ACM Press , 2023 : 590 – 591 .

XU Y N , FENG D Q , ZHAO M X , et al . Edge intelligence empowered metaverse: architecture, technologies, and open Issues [J ] . IEEE Network , 2023 , 37 ( 6 ): 92 - 100 .

ZHOU Y Q , TIAN L , LIU L , et al . Fog computing enabled future mobile communication networks: a convergence of communication and computing [J ] . IEEE Communications Magazine , 2019 , 57 ( 5 ): 20 - 27 .

FENG D Q , LU L , WU Y Y , et al . Device-to-device communications underlaying cellular networks [J ] . IEEE Transactions on Communications , 2013 , 61 ( 8 ): 3541 - 3551 .

POLYS N , WASI S M . Increasing Web3D accessibility with audio captioning [C ] // Proceedings of the 28th International ACM Conference on 3D Web Technology . New York : ACM Press , 2023 : Article 6 .

LI L , HUANG Y K , QIAO X Q , et al . Towards distributed collaborative rendering service for immersive mobile Web [J ] . IEEE Network , 2023 , 38 ( 3 ): 137 - 145 .

ZHANG W X , LIN S K , BIJARBOONEH F H , et al . EdgeXAR: a 6-DoF camera multi-target interaction framework for MAR with user-friendly latency compensation [J ] . The Proceedings of the ACM on Human Computer Interaction , 2022 , 6(EICS): Article 152.

HUANG Y K , QIAO X Q , DUSTDAR S , et al . AoDNN: an auto-offloading approach to optimize deep inference for fostering mobile web [C ] // Proceedings of IEEE INFOCOM 2022 - IEEE Conference on Computer Communications . Piscataway : IEEE Press , 2022 : 2198 - 2207 .

GUO F X , YU F R , ZHANG H L , et al . An adaptive wireless virtual reality framework in future wireless networks: a distributed learning approach [J ] . IEEE Transactions on Vehicular Technology , 2020 , 69 ( 8 ): 8514 - 8528 .

ZHAO M Q , ZHENG J M , LIU E S . Server allocation for massively multiplayer online cloud games using evolutionary optimization [J ] . ACM Transactions on Multimedia Computing, Communications, and Applications , 2021 , 17 ( 2 ): Article 51 .

REN P , LIU L , QIAO X Q , et al . Distributed edge system orchestration for web-based mobile augmented reality services [J ] . IEEE Transactions on Services Computing , 2023 , 16 ( 3 ): 1778 - 1792 .

REN P , QIAO X Q , HUANG Y K , et al . Edge AR X5: an edge-assisted multi-user collaborative framework for mobile web augmented reality in 5G and beyond [J ] . IEEE Transactions on Cloud Computing , 2022 , 10 ( 4 ): 2521 - 2537 .

许昊天 . WebVR大规模三维虚拟场景轻量对等传输关键技术 [J ] . 电脑知识与技术 , 2019 , 15 ( 3 ): 215 - 217 .

XU H T . Key technologies of lightweight peer-to-peer transmission of large-scale 3D virtual scene in WebVR [J ] . Computer Knowledge and Technology , 2019 , 15 ( 3 ): 215 - 217 .

WU J K , GUAN Y , MAO Q , et al . ZGaming: zero-latency 3D cloud gaming by image prediction [C ] // Proceedings of the ACM SIGCOMM 2023 Conference . New York : ACM Press , 2023 : 710 – 723 .

李柯 , 张乾 , 贾金原 . 云边页协同的WebBIM大场景多粒度兴趣加载调度算法 [J ] . 计算机辅助设计与图形学学报 , 2021 , 33 ( 9 ): 1388 - 1397 .

LI K , ZHANG Q , JIA J Y . CEB-collaboratively multi-granularity interest scheduling algorithm for loading large WebBIM scene [J ] . Journal of Computer-Aided Design & Computer Graphics , 2021 , 33 ( 9 ): 1388 - 1397 .

LEMOINE W , WIJNANTS M . Progressive network streaming of textured meshes in the binary glTF 2.0 format [C ] // Proceedings of the 28th International ACM Conference on 3D Web Technology . New York : ACM Press , 2023 : Article 7 .

LIU C , OOI W T , JIA J Y , et al . Cloud baking: collaborative scene illumination for dynamic Web3D scenes [J ] . ACM Transactions on Multimedia Computing, Communications, and Applications , 2018 , 14 ( 3 ): Article 59 .

CHEN Y F , CAI W T , LIU E S . Hot area targeting dead reckoning for distributed virtual environments [C ] // Proceedings of the 2021 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation . New York : ACM Press , 2021 : 129 – 137 .

YANG J C , GUO Z W , LUO J T , et al . Cloud-edge-end collaborative caching based on graph learning for cyber-physical virtual reality [J ] . IEEE Systems Journal , 2023 , 17 ( 4 ): 5097 - 5108 .

KUMAR S , BHAGAT L , A A F , et al . Multi-neural network based tiled 360°video caching with mobile edge computing [J ] . Journal of Network and Computer Applications , 2022 ( 201 ): 103342 .

LIU X J , JIA J Y , LIU C H . Survey of lightweighting methods of huge 3D models for online Web3D visualization [J ] . Virtual Reality & Intelligent Hardware , 2023 , 5 ( 5 ): 395 - 406 .

张韵 , 王淑营 , 郑庆 , 等 . 保持细节几何特征的三维网格模型轻量化算法 [J ] . 计算机应用 , 2023 , 43 ( 4 ): 1226 - 1232 .

ZHANG Y , WANG S Y , ZHENG Q , et al . Lightweight algorithm of 3D mesh model for preserving detailed geometric features [J ] . Journal of Computer Applications , 2023 , 43 ( 4 ): 1226 - 1232 .

ZHOU C H , LIANG L . Research and implementation of lightweight technology for digital twin models of complex equipment [C ] // Proceedings of 2023 IEEE 7th Information Technology and Mechatronics Engineering Conference (ITOEC) . Piscataway : IEEE Press , 2023 : 857 - 862 .

LENG J W , LIN Z S , HUANG Z Q , et al . Rapid simplification of 3D geometry model of mechanisms in the digital twins-driven manufacturing system design [J ] . Journal of Intelligent Manufacturing , 2023 , 35 : 2765 – 2786 .

CHEN Z Q . A review of deep learning-powered mesh reconstruction methods [EB ] . 2023 .

HU Y B , YE S , ZHAO W , et al . O 2 -Recon: completing 3D reconstruction of occluded objects in the scene with a pre-trained 2D diffusion model [J ] . Proceedings of the AAAI Conference on Artificial Intelligence , 2024 , 38 ( 3 ): 2285 - 2293 .

WEN B W , TREMBLAY J , BLUKIS V , et al . BundleSDF: neural 6-DoF tracking and 3D reconstruction of unknown objects [C ] // Proceedings of 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE Press , 2023 : 606 - 617 .

REN K R , JIANG L H , LU T , et al . Octree-GS: towards consistent real-time rendering with LOD-structured 3D Gaussians [EB ] . 2024 .

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于边缘计算的视频监控系统及应用