基于球形加权结构相似度的全向视频编码率失真优化方法

周瑜锋; 郁梅; 杜宝祯; 宋洋; 蒋刚毅

doi:10.11959/j.issn.1000-0801.2019025

您当前的位置：

首页 >

文章列表页 >

基于球形加权结构相似度的全向视频编码率失真优化方法

研究与开发 | 更新时间：2024-06-05

- 基于球形加权结构相似度的全向视频编码率失真优化方法
- Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity
- 电信科学 2019年35卷第2期页码：59-69
- 作者机构：
- 作者简介：
  
  [ "周瑜锋（1995- ），男，宁波大学信息科学与工程学院硕士生，主要研究方向为全向视频系统信号处理与编码。" ]
  [ "郁梅（1968- ），女，博士，宁波大学信息科学与工程学院教授，主要研究方向为三维视频系统信号处理、编码，视觉感知质量评价与系统优化。" ]
  [ "杜宝祯（1985- ），男，宁波大学信息科学与工程学院博士生，主要研究方向为视觉感知模型研究与三维视频感知编码。" ]
  [ "宋洋（1989- ），男，宁波大学信息科学与工程学院博士生，主要研究方向为图像处理与视觉通信、视频图像质量评价。" ]
  [ "蒋刚毅（1964- ），男，博士，宁波大学信息科学与工程学院教授，主要研究方向为全向视频/三维视频系统信号处理、编码与传输，视觉感知质量评价与系统优化。" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61671258);国家自然科学基金资助项目;The National Natural Science Foundation of China(61871247);浙江省自然科学基金资助项目;The Natural Science Foundation of Zhejiang Province of China(LY15F010005)
- DOI：10.11959/j.issn.1000-0801.2019025
  中图分类号： TN919
- 网络出版日期：2019-02，
  
  纸质出版日期：2019-02-20
- 稿件说明：
移动端阅览
周瑜锋, 郁梅, 杜宝祯, 等. 基于球形加权结构相似度的全向视频编码率失真优化方法[J]. 电信科学, 2019,35(2):59-69.

Yufeng ZHOU, Mei YU, Baozhen DU, et al. Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity[J]. Telecommunications science, 2019, 35(2): 59-69.
周瑜锋, 郁梅, 杜宝祯, 等. 基于球形加权结构相似度的全向视频编码率失真优化方法[J]. 电信科学, 2019,35(2):59-69. DOI： 10.11959/j.issn.1000-0801.2019025.

Yufeng ZHOU, Mei YU, Baozhen DU, et al. Omni directional video coding rate distortion optimization method based on weighted-to-spherically-uniform structural similarity[J]. Telecommunications science, 2019, 35(2): 59-69. DOI： 10.11959/j.issn.1000-0801.2019025.

摘要

针对传统视频编码中编码率失真模型的不足，考虑等矩形全向视频的特征，提出一种基于球形加权结构相似度（WS-SSIM）的全向视频编码率失真优化方法。通过考虑投影平面内部结构相似度的失真情况，以及球面失真与投影平面失真的关系，提出“球形加权结构相似度”来描述平面全向图像局部块相对于观看球面的失真程度，将其应用于全向视频编码的率失真优化过程并自适应选择量化参数，以提高基于视觉的编码效率。实验结果表明，与HEVC视频编码标准的HM16.9测试平台的方法相比，所提出方法在相同视觉质量下可平均节省24.48%的码率，说明该方法对于提高全向视频编码率失真性能具有显著的效果。

Abstract

Aiming at the shortcomings of the coding rate distortion model in traditional video coding

considering the characteristics of equal rectangular omnidirectional video

a method of omnidirectional video coding rate distortion optimization based on spherical weighted structural similarity (WS-SSIM) was proposed.By considering the distortion of the internal structural similarity of the projection plane and the relationship between the spherical distortion and the projection plane distortion

the “spherical weighted structural similarity” was proposed to describe the degree of distortion of the planar omnidirectional image local block relative to the viewing sphere

which was applied to the rate-distortion optimization process of omnidirectional video coding and adaptive selection of quantization parameters to improve vision-based coding efficiency.The experimental results show that compared with the HEVC video coding standard HM16.9 test platform

the proposed method can save an average of 24.48% code rate under the same visual quality

which indicates that the method has significant performance for improving the omnidirectional video coding rate distortion performance.

关键词

Keywords

references

罗莹 , 宋利 , 解蓉 , 等 . 全景媒体的系统架构研究综述 [J ] . 电信科学 , 2018 , 34 ( 2 ): 88 - 98 .

LUO Y , SONG L , XIE R , et al . Review of system architecture of omnidirectional media [J ] . Telecommunications Science , 2018 , 34 ( 2 ): 88 - 98 .

RAI Y , CALLET P L , GUILLOTEL P . Which saliency weighting for omni directional image quality assessment? [C ] // Ninth International Conference on Quality of Multimedia Experience,May 31-June 2,2017,Erfurt,Germany . Piscataway:IEEE Press , 2017 : 1 - 6 .

CHEN Z Z , LI Y M , ZHANG Y X . Recent advances in omnidirectional video coding for virtual reality:projection and evaluation [J ] . Signal Processing , 2018 ( 146 ): 66 - 78 .

罗传飞 , 孔德辉 , 刘翔凯 , 等 . 智慧家庭的VR全景视频业务实现 [J ] . 电信科学 , 2017 , 33 ( 10 ): 185 - 193 .

LUO C F , KONG D H , LIU X K , et al . A business realization of VR panoramic video in smart home [J ] . Telecommunications Science , 2017 , 33 ( 10 ): 185 - 193 .

SIMONE F D , FROSSARD P , WILKINS P , et al . Geometry-driven quantization for omnidirectional image coding [C ] // Picture Coding Symposium (PCS),Dec 4-7,2016,Nuremberg,Germany . Piscataway:IEEE Press , 2016 : 1 - 5 .

LI L , LI Z , BUDAGAVI M , et al . Projection based advanced motion model for cubic mapping for 360-degree video [C ] // 2017 IEEE International Conference on Image Processing (ICIP),Sept 17-20,2017,Beijing,China . Piscataway:IEEE Press , 2017 : 1427 - 1431 .

LIN H C , HUANG C C , LI C Y , et al . AHG8:an improvement on the compact OHP layout [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,JVET-E0056,January 12-20,2017,Geneva,Switzerland.[S.l.:s.n . ] , 2017 .

ZARE A , AMINLOU A , HANNUKSELA M , et al . HEVC-compliant tile-based streaming of panoramic video for virtual reality applications [C ] // ACM International Conference on Multimedia,October 15-19,2016,Amsterdam,The Netherlands . New York:ACM Press , 2016 : 601 - 605 .

QIAN F , GOPALAKRISHNAN V , et al . Optimizing 360 video delivery over cellular networks [C ] // The Workshop on All Things Cellular:Operations,Applications and Challenges,October 3-7,2016,New York,USA . New York:ACM Press , 2016 : 1 - 6 .

SKUPIN R , SANCHEZ Y , PODBORSKI D , et al . HEVC tile based streaming to head mounted displays [C ] // 14th IEEE Annual Consumer Communications ＆ Networking Conference (CCNC),Jan 8-11,2017,Las Vegas,NV,USA . Piscataway:IEEE Press , 2017 : 613 - 615 .

TANG M , ZHANG Y , WEN J , et al . Optimized video coding for omnidirectional videos [C ] // IEEE International Conference on Multimedia and Expo,July 10-14,2017,Hong Kong,China . Piscataway:IEEE Press , 2017 : 799 - 804 .

YOUVALARI R G , AMINLOU A , HANNUKSELA M . Analysis of regional down-sampling methods for coding of omnidirectional video [C ] // Picture Coding Symposium (PCS),Dec 4-7,2016,Nuremberg,Germany . Piscataway:IEEE Press , 2016 : 1 - 5 .

HENDR Y , MUHAMMED C , MARTA K , et al . AHG8:adaptive QP for 360º video ERP projection [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO//IEC JTC1/SC29/WG11 JVET-F0049,March 31-April 7,2017,Hobart,Australia.[S.l.:s.n . ] , 2017 .

SUN Y , LU A , YU L . Weighted-to-spherically-uniform quality evaluation for omnidirectional video [J ] . IEEE Signal Processing Letters , 2017 , 24 ( 9 ): 1408 - 1412 .

YU M , LAKSHMAN H , GIROD B . A framework to evaluate omnidirectional video coding schemes [C ] // IEEE International Symposium on Mixed and Augmented Reality,Sept 29-Oct 3,2015,Fukuoka,Japan . Piscataway:IEEE Press , 2015 : 31 - 36 .

ZAKHARCHENKO V , ALSHINA E , SINGH A , et al . AHG8:suggested testing procedure for 360-degree video [C ] // Joint Video Exploration Team (JVET) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11.JVET-D0027,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment:from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

YEO C , TAN H L , TAN Y H . SSIM-based adaptive quantization in HEVC [C ] // IEEE International Conference on Acoustics,Speech and Signal Processing,May 26-31,2013,Vancouver,BC,Canada . Piscataway:IEEE Press , 2013 : 1690 - 1694 .

CORBILLON X , DE SIMONE F , SIMON G . 360-degree video head movement dataset [C ] // ACM on Multimedia Systems Conference,June 20-23,2017,Taipei,China . New York:ACM Press , 2017 : 199 - 204 .

ZHAO P , LIU Y , LIU J , et al . Low-complexity content-adaptive Lagrange multiplier decision for SSIM-based RD-optimized video coding [C ] // IEEE International Symposium on Circuits and Systems,May 19-23,2013,Beijing,China . Piscataway:IEEE Press , 2013 : 485 - 488 .

YEO C , TAN H L , TAN Y H . On rate distortion optimization using SSIM [J ] . IEEE Transactions on Circuits ＆ Systems for Video Technology , 2013 , 23 ( 7 ): 1170 - 1181 .

SEBASTIAN S , ALIREZA A , IGOR D , et al . AHG8:tampere pole vaulting sequence for virtual reality video coding [C ] // Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11.JVET-D0143,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

SUN W B , GUO R D , MEN X H , et al . AHG8:test sequences for virtual reality video coding from LetinVR [C ] // Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11.JVET-D0179,October 15-21,2016,Chengdu,China.[S.l.:s.n] . 2016 .

浏览量

636

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于显著特征的HEVC帧内率失真优化