Review of system architecture of omnidirectional media

Ying LUO; Li SONG; Rong XIE; Chuanfei LUO

doi:10.11959/j.issn.1000-0801.2018007

您当前的位置：

首页 >

文章列表页 >

Review of system architecture of omnidirectional media

summarize | 更新时间：2024-06-05

- Review of system architecture of omnidirectional media
- Telecommunications Science Vol. 34, Issue 2, Pages: 88-98(2018)
- 作者机构：
  
  1. 上海交通大学图像通信与网络工程研究所，上海 200240
  2. 中国电信股份有限公司上海研究院，上海 200122
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2018007
  CLC： TP393
- Published Online：2018-02，
  
  Published：20 February 2018
- 稿件说明：
移动端阅览
Ying LUO, Li SONG, Rong XIE, et al. Review of system architecture of omnidirectional media[J]. Telecommunications science, 2018, 34(2): 88-98.
DOI：

Ying LUO, Li SONG, Rong XIE, et al. Review of system architecture of omnidirectional media[J]. Telecommunications science, 2018, 34(2): 88-98. DOI： 10.11959/j.issn.1000-0801.2018007.

摘要

随着虚拟现实技术的不断发展，全景媒体系统的标准制定与完善逐渐显示出越来越重要的作用。为了规范虚拟现实系统，研究全景媒体的系统架构具有重要的价值。首先回顾了目前虚拟现实技术的发展以及在实际应用中存在的问题。其次，介绍了全景多媒体的应用框架的结构和发展趋势，针对国际标准组织MPEG OMAF架构以及Facebook和Google的全景媒体应用架构进行了简要的介绍。通过对几种系统架构的对比分析，对全景媒体应用的发展做出了总结和展望。

Abstract

With the development of virtual reality technology

the formulation and perfection of omnidirectional media system standard plays a more important role.In order to standardize the virtual reality system

it is of great value to study the system architecture of omnidirectional media.Firstly

the current development of virtual reality technology and the problems in practical application were reviewed.Secondly

the structure and development trend of the application framework of omnidirectional media were introduced.Then the application architectures of MPEG OMAF

Facebook and Google were introduced separately.Through the comparative analysis of several system architecture schemes

the development of omnidirectional multimedia was summarized and prospected.

关键词

Keywords

references

董振江 , 张东卓 , 黄成 , 等 . 虚拟现实视频处理与传输技术 [J ] . 电信科学 , 2017 , 33 ( 8 ): 45 - 52 .

DONG Z J , ZHANG D Z , HUANG C , et al . Technology of virtual reality video processing and streaming [J ] . Telecommunications Science , 2017 , 33 ( 8 ): 45 - 52 .

ISO/IEC JTC1/SC29/WG11/M37044.Use cases and requirements of omnidirectional media format,MPEG 113 [S ] . 2015 .

ISO/IEC JTC1/SC29/WG11/N16189.WD on ISO/IEC 23000-20 omnidirectional media application format,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M37152.Future video coding requirements on virtual reality,MPEG 113 [S ] . 2015 .

ISO/IEC JTC1/SC29/WG11/M37914.Support of vr video in iso base media file format,MPEG114 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M38662.Dash descriptor for omnidirectional media,MPEG 115 [S ] . 2016 .

WANG R G . VRU (virtual reality union) meeting report,AVS-N2422 [R ] . 2017 .

ISO/IEC JTC1/SC29/WG11/N16824.Text of iso/iec dis 23090-2 omnidirectional media format,MPEG 118 [S ] . 2017 .

ISO/IEC JTC1/SC29/WG11/M39469.OMAF:lens shading parameters metadata for omnidirectional video,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M39380.OMAF:camera and lens parameter for stereo 360-degree video using fisheye cameras,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M40178.Update of OMAF PROJ-VE description,MPEG 117 [S ] . 2017 .

ISO/IEC JTC1/SC29/WG11/N16828.Projections under considerations for ISO/IEC 23000-20 omnidirectional media application format,MPEG 118 [S ] . 2017 .

BUDAGAVI M , FURTON J , JIN G , et al . 360 degrees video coding using region adaptive smoothing [C ] // IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada . Piscataway:IEEE Press , 2015 : 750 - 754 .

JIN G , SAXENA A , BUDAGAVI M . Motion estimation and compensation for fisheye warped video [C ] // IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada . Piscataway:IEEE Press , 2015 : 2751 - 2755 .

SKUPIN R , SANCHEZ Y , HELLGE C , et al . Tile based HEVC video for head mounted displays [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 399 - 400 .

HOSSEINI M , SWAMINATHAN V . Adaptive 360 VR video streaming:divide and conquer [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 107 - 110 .

祝谷乔 , 宋皓 . MPEG-DASH与HLS流传输技术的比较分析 [J ] . 电信科学 , 2015 , 31 ( 4 ): 23 - 27 .

ZHU G Q , SONG H . Comparison and analysis of MPEGDASH and HLS adaptive streaming delivery technology [J ] . Telecommunications Science , 2015 , 31 ( 4 ): 23 - 27 .

SREEDHAR K K , AMINLOU A , HANNUKSELA M M , et al . Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 583 - 586 .

ZARE A , AMINLOU A , HANNUKSELA M M , et al . HEVC-compliant tile-based streaming of panoramic video for virtual reality applications [C ] // Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 601 - 605 .

XIE L , XU Z M , BAN Y X , et al . 360ProbDASH:improving QoE of 360 video streaming using tile-based http adaptive streaming [C ] // Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 521 - 525 .

周建同 , 杨海涛 , 刘东 , 等 . 视频编码的技术基础及发展方向 [J ] . 电信科学 , 2017 , 33 ( 8 ): 16 - 25 .

ZHOU J T , YANG H T , LIU D , et al . Trends and technologies of video coding [J ] . Telecommunications Science , 2017 , 33 ( 8 ): 16 - 25 .

FAUTIER T . VR video ecosystem for live distribution [J ] . IBC 2016 Conference , 2016 , 28 ( 13 ): 32 - 36 .

QIAN F , JI L S , HAN B , et al . Optimizing 360 video delivery over cellular networks [C ] // Proceedings of the 5th Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA . New York:ACM Press , 2016 : 1 - 6 .

Views

1565

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Mobile VR application in 5G network

A business realization of VR panoramic video in smart home

Technology of virtual reality video processing and streaming

Trends and technologies of video coding

Related Author

Qingyang WANG

Yilin LIN

Jie LIU

Chuanfei LUO

Dehui KONG

Xiangkai LIU

Ke XU

Hao YANG

Related Institution

Shenzhen Sanechips Technology Corporation

Huawei Technologies Co., Ltd.

University of Science and Technology of China,Heifei

⁰