全景媒体的系统架构研究综述

罗莹; 宋利; 解蓉; 罗传飞

doi:10.11959/j.issn.1000-0801.2018007

您当前的位置：

首页 >

文章列表页 >

全景媒体的系统架构研究综述

综述 | 更新时间：2024-06-05

- 全景媒体的系统架构研究综述
- Review of system architecture of omnidirectional media
- 电信科学 2018年34卷第2期页码：88-98
- 作者机构：
  
  1. 上海交通大学图像通信与网络工程研究所，上海 200240
  2. 中国电信股份有限公司上海研究院，上海 200122
- 作者简介：
  
  [ "罗莹（1993-），女，上海交通大学图像通信与网络工程研究所硕士生，主要研究方向为视频通信与处理、虚拟现实技术。" ]
  [ "宋利（1975-），男，上海交通大学图像通信与网络工程研究所研究员，主要研究方向为图像处理、视频编码。" ]
  [ "解蓉（1975-），女，上海交通大学图像通信与网络工程研究所副教授，主要研究方向为视频编码与通信、视频处理。" ]
  [ "罗传飞（1978-），男，中国电信股份有限公司上海研究院高级工程师，主要研究方向为IPTV系统、视频体验技术等。" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61671296);国家自然科学基金资助项目;The National Natural Science Foundation of China(61521062)
- DOI：10.11959/j.issn.1000-0801.2018007
  中图分类号： TP393
- 网络出版日期：2018-02，
  
  纸质出版日期：2018-02-20
- 稿件说明：
移动端阅览
罗莹, 宋利, 解蓉, 等. 全景媒体的系统架构研究综述[J]. 电信科学, 2018,34(2):88-98.

Ying LUO, Li SONG, Rong XIE, et al. Review of system architecture of omnidirectional media[J]. Telecommunications science, 2018, 34(2): 88-98.
罗莹, 宋利, 解蓉, 等. 全景媒体的系统架构研究综述[J]. 电信科学, 2018,34(2):88-98. DOI： 10.11959/j.issn.1000-0801.2018007.

Ying LUO, Li SONG, Rong XIE, et al. Review of system architecture of omnidirectional media[J]. Telecommunications science, 2018, 34(2): 88-98. DOI： 10.11959/j.issn.1000-0801.2018007.

摘要

随着虚拟现实技术的不断发展，全景媒体系统的标准制定与完善逐渐显示出越来越重要的作用。为了规范虚拟现实系统，研究全景媒体的系统架构具有重要的价值。首先回顾了目前虚拟现实技术的发展以及在实际应用中存在的问题。其次，介绍了全景多媒体的应用框架的结构和发展趋势，针对国际标准组织MPEG OMAF架构以及Facebook和Google的全景媒体应用架构进行了简要的介绍。通过对几种系统架构的对比分析，对全景媒体应用的发展做出了总结和展望。

Abstract

With the development of virtual reality technology

the formulation and perfection of omnidirectional media system standard plays a more important role.In order to standardize the virtual reality system

it is of great value to study the system architecture of omnidirectional media.Firstly

the current development of virtual reality technology and the problems in practical application were reviewed.Secondly

the structure and development trend of the application framework of omnidirectional media were introduced.Then the application architectures of MPEG OMAF

Facebook and Google were introduced separately.Through the comparative analysis of several system architecture schemes

the development of omnidirectional multimedia was summarized and prospected.

关键词

Keywords

references

董振江 , 张东卓 , 黄成 , 等 . 虚拟现实视频处理与传输技术 [J ] . 电信科学 , 2017 , 33 ( 8 ): 45 - 52 .

DONG Z J , ZHANG D Z , HUANG C , et al . Technology of virtual reality video processing and streaming [J ] . Telecommunications Science , 2017 , 33 ( 8 ): 45 - 52 .

ISO/IEC JTC1/SC29/WG11/M37044.Use cases and requirements of omnidirectional media format,MPEG 113 [S ] . 2015 .

ISO/IEC JTC1/SC29/WG11/N16189.WD on ISO/IEC 23000-20 omnidirectional media application format,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M37152.Future video coding requirements on virtual reality,MPEG 113 [S ] . 2015 .

ISO/IEC JTC1/SC29/WG11/M37914.Support of vr video in iso base media file format,MPEG114 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M38662.Dash descriptor for omnidirectional media,MPEG 115 [S ] . 2016 .

WANG R G . VRU (virtual reality union) meeting report,AVS-N2422 [R ] . 2017 .

ISO/IEC JTC1/SC29/WG11/N16824.Text of iso/iec dis 23090-2 omnidirectional media format,MPEG 118 [S ] . 2017 .

ISO/IEC JTC1/SC29/WG11/M39469.OMAF:lens shading parameters metadata for omnidirectional video,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M39380.OMAF:camera and lens parameter for stereo 360-degree video using fisheye cameras,MPEG 116 [S ] . 2016 .

ISO/IEC JTC1/SC29/WG11/M40178.Update of OMAF PROJ-VE description,MPEG 117 [S ] . 2017 .

ISO/IEC JTC1/SC29/WG11/N16828.Projections under considerations for ISO/IEC 23000-20 omnidirectional media application format,MPEG 118 [S ] . 2017 .

BUDAGAVI M , FURTON J , JIN G , et al . 360 degrees video coding using region adaptive smoothing [C ] // IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada . Piscataway:IEEE Press , 2015 : 750 - 754 .

JIN G , SAXENA A , BUDAGAVI M . Motion estimation and compensation for fisheye warped video [C ] // IEEE International Conference on Image Processing,Sept 27-30,2015,Quebec City,Canada . Piscataway:IEEE Press , 2015 : 2751 - 2755 .

SKUPIN R , SANCHEZ Y , HELLGE C , et al . Tile based HEVC video for head mounted displays [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 399 - 400 .

HOSSEINI M , SWAMINATHAN V . Adaptive 360 VR video streaming:divide and conquer [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 107 - 110 .

祝谷乔 , 宋皓 . MPEG-DASH与HLS流传输技术的比较分析 [J ] . 电信科学 , 2015 , 31 ( 4 ): 23 - 27 .

ZHU G Q , SONG H . Comparison and analysis of MPEGDASH and HLS adaptive streaming delivery technology [J ] . Telecommunications Science , 2015 , 31 ( 4 ): 23 - 27 .

SREEDHAR K K , AMINLOU A , HANNUKSELA M M , et al . Viewport-adaptive encoding and streaming of 360-degree video for virtual reality applications [C ] // IEEE International Symposium on Multimedia,Dec 11-13,2016,San Jose,USA . Piscataway:IEEE Press , 2016 : 583 - 586 .

ZARE A , AMINLOU A , HANNUKSELA M M , et al . HEVC-compliant tile-based streaming of panoramic video for virtual reality applications [C ] // Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 601 - 605 .

XIE L , XU Z M , BAN Y X , et al . 360ProbDASH:improving QoE of 360 video streaming using tile-based http adaptive streaming [C ] // Proceedings of the 2016 ACM International Conference on Multimedia(MM),October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 521 - 525 .

周建同 , 杨海涛 , 刘东 , 等 . 视频编码的技术基础及发展方向 [J ] . 电信科学 , 2017 , 33 ( 8 ): 16 - 25 .

ZHOU J T , YANG H T , LIU D , et al . Trends and technologies of video coding [J ] . Telecommunications Science , 2017 , 33 ( 8 ): 16 - 25 .

FAUTIER T . VR video ecosystem for live distribution [J ] . IBC 2016 Conference , 2016 , 28 ( 13 ): 32 - 36 .

QIAN F , JI L S , HAN B , et al . Optimizing 360 video delivery over cellular networks [C ] // Proceedings of the 5th Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA . New York:ACM Press , 2016 : 1 - 6 .

浏览量

1565

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

5G网络中的移动VR应用

智慧家庭的VR全景视频业务实现

虚拟现实视频处理与传输技术

视频编码的技术基础及发展方向