Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity

Yufeng ZHOU; Mei YU; Baozhen DU; Yang SONG; Gangyi JIANG

doi:10.11959/j.issn.1000-0801.2019025

您当前的位置：

首页 >

文章列表页 >

Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity

research and development | 更新时间：2024-06-05

- Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity
- Telecommunications Science Vol. 35, Issue 2, Pages: 59-69(2019)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2019025
  CLC： TN919
- Published Online：2019-02，
  
  Published：20 February 2019
- 稿件说明：
移动端阅览
Yufeng ZHOU, Mei YU, Baozhen DU, et al. Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity[J]. Telecommunications science, 2019, 35(2): 59-69.
DOI：

Yufeng ZHOU, Mei YU, Baozhen DU, et al. Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity[J]. Telecommunications science, 2019, 35(2): 59-69. DOI： 10.11959/j.issn.1000-0801.2019025.

摘要

针对传统视频编码中编码率失真模型的不足，考虑等矩形全向视频的特征，提出一种基于球形加权结构相似度（WS-SSIM）的全向视频编码率失真优化方法。通过考虑投影平面内部结构相似度的失真情况，以及球面失真与投影平面失真的关系，提出“球形加权结构相似度”来描述平面全向图像局部块相对于观看球面的失真程度，将其应用于全向视频编码的率失真优化过程并自适应选择量化参数，以提高基于视觉的编码效率。实验结果表明，与HEVC视频编码标准的HM16.9测试平台的方法相比，所提出方法在相同视觉质量下可平均节省24.48%的码率，说明该方法对于提高全向视频编码率失真性能具有显著的效果。

Abstract

Aiming at the shortcomings of the coding rate distortion model in traditional video coding

considering the characteristics of equal rectangular omnidirectional video

a method of omnidirectional video coding rate distortion optimization based on spherical weighted structural similarity (WS-SSIM) was proposed.By considering the distortion of the internal structural similarity of the projection plane and the relationship between the spherical distortion and the projection plane distortion

the “spherical weighted structural similarity” was proposed to describe the degree of distortion of the planar omnidirectional image local block relative to the viewing sphere

which was applied to the rate-distortion optimization process of omnidirectional video coding and adaptive selection of quantization parameters to improve vision-based coding efficiency.The experimental results show that compared with the HEVC video coding standard HM16.9 test platform

the proposed method can save an average of 24.48% code rate under the same visual quality

which indicates that the method has significant performance for improving the omnidirectional video coding rate distortion performance.

关键词

Keywords

references

罗莹 , 宋利 , 解蓉 , 等 . 全景媒体的系统架构研究综述 [J ] . 电信科学 , 2018 , 34 ( 2 ): 88 - 98 .

LUO Y , SONG L , XIE R , et al . Review of system architecture of omnidirectional media [J ] . Telecommunications Science , 2018 , 34 ( 2 ): 88 - 98 .

RAI Y , CALLET P L , GUILLOTEL P . Which saliency weighting for omni directional image quality assessment? [C ] // Ninth International Conference on Quality of Multimedia Experience,May 31-June 2,2017,Erfurt,Germany . Piscataway:IEEE Press , 2017 : 1 - 6 .

CHEN Z Z , LI Y M , ZHANG Y X . Recent advances in omnidirectional video coding for virtual reality:projection and evaluation [J ] . Signal Processing , 2018 ( 146 ): 66 - 78 .

罗传飞 , 孔德辉 , 刘翔凯 , 等 . 智慧家庭的VR全景视频业务实现 [J ] . 电信科学 , 2017 , 33 ( 10 ): 185 - 193 .

LUO C F , KONG D H , LIU X K , et al . A business realization of VR panoramic video in smart home [J ] . Telecommunications Science , 2017 , 33 ( 10 ): 185 - 193 .

SIMONE F D , FROSSARD P , WILKINS P , et al . Geometry-driven quantization for omnidirectional image coding [C ] // Picture Coding Symposium (PCS),Dec 4-7,2016,Nuremberg,Germany . Piscataway:IEEE Press , 2016 : 1 - 5 .

LI L , LI Z , BUDAGAVI M , et al . Projection based advanced motion model for cubic mapping for 360-degree video [C ] // 2017 IEEE International Conference on Image Processing (ICIP),Sept 17-20,2017,Beijing,China . Piscataway:IEEE Press , 2017 : 1427 - 1431 .

LIN H C , HUANG C C , LI C Y , et al . AHG8:an improvement on the compact OHP layout [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,JVET-E0056,January 12-20,2017,Geneva,Switzerland.[S.l.:s.n . ] , 2017 .

ZARE A , AMINLOU A , HANNUKSELA M , et al . HEVC-compliant tile-based streaming of panoramic video for virtual reality applications [C ] // ACM International Conference on Multimedia,October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 601 - 605 .

QIAN F , GOPALAKRISHNAN V , et al . Optimizing 360 video delivery over cellular networks [C ] // The Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA . New York:ACM Press , 2016 : 1 - 6 .

SKUPIN R , SANCHEZ Y , PODBORSKI D , et al . HEVC tile based streaming to head mounted displays [C ] // 14th IEEE Annual Consumer Communications ＆ Networking Conference (CCNC),Jan 8-11,2017,Las Vegas,NV,USA . Piscataway:IEEE Press , 2017 : 613 - 615 .

TANG M , ZHANG Y , WEN J , et al . Optimized video coding for omnidirectional videos [C ] // IEEE International Conference on Multimedia and Expo,July 10-14,2017,Hong Kong,China . Piscataway:IEEE Press , 2017 : 799 - 804 .

YOUVALARI R G , AMINLOU A , HANNUKSELA M . Analysis of regional down-sampling methods for coding of omnidirectional video [C ] // Picture Coding Symposium (PCS),Dec 4-7,2016,Nuremberg,Germany . Piscataway:IEEE Press , 2016 : 1 - 5 .

HENDR Y , MUHAMMED C , MARTA K , et al . AHG8:adaptive QP for 360º video ERP projection [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO//IEC JTC1/SC29/WG11 JVET-F0049,March 31-April 7,2017,Hobart,Australia.[S.l.:s.n . ] , 2017 .

SUN Y , LU A , YU L . Weighted-to-spherically-uniform quality evaluation for omnidirectional video [J ] . IEEE Signal Processing Letters , 2017 , 24 ( 9 ): 1408 - 1412 .

YU M , LAKSHMAN H , GIROD B . A framework to evaluate omnidirectional video coding schemes [C ] // IEEE International Symposium on Mixed and Augmented Reality,Sept 29-Oct 3,2015,Fukuoka,Japan . Piscataway:IEEE Press , 2015 : 31 - 36 .

ZAKHARCHENKO V , ALSHINA E , SINGH A , et al . AHG8:suggested testing procedure for 360-degree video [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11.JVET-D0027,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment:from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

YEO C , TAN H L , TAN Y H . SSIM-based adaptive quantization in HEVC [C ] // IEEE International Conference on Acoustics,Speech and Signal Processing,May 26-31,2013,Vancouver,BC,Canada . Piscataway:IEEE Press , 2013 : 1690 - 1694 .

CORBILLON X , DE SIMONE F , SIMON G . 360-degree video head movement dataset [C ] // ACM on Multimedia Systems Conference,June 20-23,2017,Taipei,China . New York:ACM Press , 2017 : 199 - 204 .

ZHAO P , LIU Y , LIU J , et al . Low-complexity content-adaptive Lagrange multiplier decision for SSIM-based RD-optimized video coding [C ] // IEEE International Symposium on Circuits and Systems,May 19-23,2013,Beijing,China . Piscataway:IEEE Press , 2013 : 485 - 488 .

YEO C , TAN H L , TAN Y H . On rate distortion optimization using SSIM [J ] . IEEE Transactions on Circuits ＆ Systems for Video Technology , 2013 , 23 ( 7 ): 1170 - 1181 .

SEBASTIAN S , ALIREZA A , IGOR D , et al . AHG8:tampere pole vaulting sequence for virtual reality video coding [C ] // Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11.JVET-D0143,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

SUN W B , GUO R D , MEN X H , et al . AHG8:test sequences for virtual reality video coding from LetinVR [C ] // Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11.JVET-D0179,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

Views

636

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Rate distortion optimization based on saliency characteristic for HEVC intra coding

Related Author

Jinlong LI

Fen CHEN

Zongju PENG

Gangyi JIANG

Mei YU

Related Institution

No data

⁰