多特征融合的合成视点立体图像质量评价

崔帅南; 彭宗举; 邹文辉; 陈芬; 陈华

doi:10.11959/j.issn.1000-0801.2019070

您当前的位置：

首页 >

文章列表页 >

多特征融合的合成视点立体图像质量评价

研究与开发 | 更新时间：2024-06-05

- 多特征融合的合成视点立体图像质量评价
- Quality assessment of synthetic viewpoint stereo image with multi-feature fusion
- 电信科学 2019年35卷第5期页码：104-112
- 作者机构：
  
  1. 宁波大学信息科学与工程学院，浙江宁波 315211
  2. 西华师范大学电子信息工程学院，四川南充 637009
- 作者简介：
  
  [ "崔帅南（1993- ），女，宁波大学信息科学与工程学院硕士生，主要研究方向为虚拟视点绘制及其质量评价。" ]
  [ "彭宗举（1973- ），男，博士，宁波大学信息科学与工程学院教授，主要研究方向为三维视频信号处理与编码。" ]
  [ "邹文辉（1979- ），女，宁波大学信息科学与工程学院博士生，主要研究方向为虚拟视点绘制及其质量评价。" ]
  [ "陈芬（1973- ），女，博士，宁波大学信息科学与工程学院副教授，主要研究方向为三维视频信号处理与编码。" ]
  [ "陈华（1988- ），男，博士，宁波大学信息科学与工程学院讲师，主要研究方向为信号与信息处理。" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61771269);国家自然科学基金资助项目;The National Natural Science Foundation of China(61620106012);国家自然科学基金资助项目;The National Natural Science Foundation of China(61671258);浙江省自然科学基金资助项目;The Natural Science Foundation of Zhejiang Province of China(LY17F010005);宁波市自然科学基金资助项目;The Natural Science Foundation of Ningbo of China(2018A610052)
- DOI：10.11959/j.issn.1000-0801.2019070
  中图分类号： TN391.41
- 网络出版日期：2019-05，
  
  纸质出版日期：2019-05-20
- 稿件说明：
移动端阅览
崔帅南, 彭宗举, 邹文辉, 等. 多特征融合的合成视点立体图像质量评价[J]. 电信科学, 2019,35(5):104-112.

Shuainan CUI, Zongju PENG, Wenhui ZOU, et al. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion[J]. Telecommunications science, 2019, 35(5): 104-112.
崔帅南, 彭宗举, 邹文辉, 等. 多特征融合的合成视点立体图像质量评价[J]. 电信科学, 2019,35(5):104-112. DOI： 10.11959/j.issn.1000-0801.2019070.

Shuainan CUI, Zongju PENG, Wenhui ZOU, et al. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion[J]. Telecommunications science, 2019, 35(5): 104-112. DOI： 10.11959/j.issn.1000-0801.2019070.

摘要

提出一种多特征融合的方法，该方法融合了合成视点立体图像中失真区域、失真边缘和奇异值的特征。首先，利用视差和阈值得到符合人眼感知的失真区域，计算该区域的平均结构相似度；然后，提取合成视点边缘图像中符合人眼感知的失真边缘，计算在该区域的平均结构相似度；接着，计算原始图像与失真图像奇异值差异；最后，将上述特征值进行融合得到最终的客观质量分数。在合成视点立体图像库上进行测试，实验结果表明，Pearson 线性相关系数和Spearman相关系数均高于0.86。与现有评价方法相比，能更准确地反映合成视点立体图像质量。

Abstract

A multi-feature fusion method was proposed

the features of the distortion areas

the distortion edges and the singular value were fused.Firstly

the distortion areas corresponding to the human eyes were obtained by using the parallax and the threshold

and then the average structural similarity in these areas was calculated.Secondly

the distorted edges in the synthetic viewpoint edge image were extracted

and then the average structural similarity was calculated.Thirdly

the difference between the original image and the distorted image singular value was calculated.Finally

the three features were fused to obtain the final objective quality score.The experiment was carried out on the synthetic viewpoint stereo image library.The experimental results show that the Pearson linear correlation coefficient and the Spearman correlation coefficient are both higher than 0.86.Compared with the existing assessment methods

it can better reflect the quality of synthetic viewpoint stereo images.

关键词

Keywords

references

林金桐 , 许晓东 . 第五代移动互联网 [J ] . 电信科学 , 2015 , 31 ( 5 ): 1 - 8 .

LIN J T , XU X D . The 5th generation of mobile internet [J ] . Telecommunications Science , 2015 , 31 ( 5 ): 1 - 8 .

高峰 , 王丽芳 , 朱文涛 . 移动通信天线的未来技术发展 [J ] . 电信科学 , 2016 , 32 ( Z1 ): 78 - 82 .

GAO F , WANG L F , ZHU W T . Futher technology development of mobile communication antenna [J ] . Telecommunications Science , 2016 , 32 ( Z1 ): 78 - 82 .

ZHI J , TAMMAM T , XIAO J , et al . Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling [J ] . Eurasip Journal on Image ＆ Video Processing , 2016 ( 1 ): 19 - 19 .

SANDIC-STANKOVIC D , KUKOLI D , CALLET P L . DIBR synthesized image quality assessment based on morphological wavelets [C ] // International Workshop on Quality of Multimedia Experience,May 26-29,2015,Pylos Nestoras . Piscataway:IEEE Press , 2015 : 1 - 4 .

STANKOVIC D S , KUKOLJ D , CALLET P L . DIBR synthesized image quality assessment based on morphological pyramids [C ] // 2015 International Workshop on Quality of Multimedia Experience,May 26,2015,Pylos-Nestoras,Greece . Piscataway:IEEE Press , 2015 : 1 - 4 .

MIILLERK , SCHWARZ H , MARPE D , et al . 3D high- efficiency video coding for multi-view video and depth data [J ] . IEEE Transactions on Image Processing , 2013 , 22 ( 9 ): 3366 - 3378 .

ZHU L , ZHANG Y , WANG S , et al . Convolutional neural network based synthesized view quality enhancement for 3D video coding [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 11 ): 5365 - 5377 .

TECH G , SCHWARZ H , MIILLER K , et al . 3D video coding using the synthesized view distortion change [C ] // 2012 IEEE International Conference on Multimedia and Expo,July 9-13,2012,Melbourne,VIC,Australia . Piscataway:IEEE Press , 2012 : 25 - 28 .

WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment:from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .

BENOIT A , CALLET P L , CAMPISI P , et al . Using disparity for quality assessment of stereoscopic images [C ] // IEEE International Conference on Image Processing,Oct 12-15,2008,San Diego,CA,USA . Piscataway:IEEE Press , 2008 : 389 - 392 .

CHEN M J , SU C C , KWON D K , et al . Full-reference quality assessment of stereopairs accounting for rivalry [J ] . Signal Processing Image Communication , 2013 , 28 ( 9 ): 1143 - 1155 .

ZHOU Y , LI L , GU K , et al . DIBR-synthesized image quality assessment via statistics of edge intensity and orientation [J ] . Transactions on Information ＆ Systems , 2017 , 100 ( 8 ): 1929 - 1933 .

BATTISITI F , BOSC E , CARLI M , et al . Objective image quality assessment of 3D synthesized views [J ] . Signal Processing Image Communication , 2015 , 30 ( C ): 78 - 88 .

BOSC E , PEPION R , CALLET P L , et al . Towards a new quality metric for 3D synthesized view assessment [J ] . IEEE Journal of Selected Topics in Signal Processing , 2011 , 5 ( 7 ): 1332 - 1343 .

GU K , JAKHETIYA V , QIAO J F , et al . Model-based referenceless quality metric of 3D synthesized images using local image description [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 1 ): 394 - 405 .

TIAN S , ZHANG L , MORIN L , et al . NIQSV+:a no-reference synthesized view quality assessment metric [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 4 ): 1652 - 1664 .

YONG J J , KIM H G , YONG M R . Critical binocular asymmetry measure for the perceptual quality assessment of synthesized stereo 3D images in view synthesis [J ] . IEEE Transactions on Circuits ＆ Systems for Video Technology , 2016 , 26 ( 7 ): 1201 - 1214 .

ZHAO Y , CHEN Z , ZHU C , et al . Binocular just-noticeabledifference model for stereoscopic images [J ] . IEEE Signal Processing Letters , 2010 , 18 ( 1 ): 19 - 22 .

SHANYDERMAN A , GUSEV A , ESKICIOGLU A M . An SVD-based grayscale image quality measure for local and global assessment [J ] . IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 422 - 429 .

IVY LAB Stereoscopic 3D image database for quality assessment of synthesized stereoimages [EB ] . 2014 .

Middlebury stereo datasets [Z ] .

浏览量

388

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

一种自由视点视频系统中立体图像质量的评价方法

特征增强和双线性特征向量融合的移动端工业货箱文本检测