浏览全部资源
扫码关注微信
Quality assessment of synthetic viewpoint stereo image with multi-feature fusion
- Telecommunications Science Vol. 35, Issue 5, Pages: 104-112(2019)
- 作者机构：
1. 宁波大学信息科学与工程学院，浙江 宁波 315211
2. 西华师范大学电子信息工程学院，四川 南充 637009
- 作者简介：
- 基金信息：
DOI：10.11959/j.issn.1000-0801.2019070
CLC： TN391.41-
Published Online：2019-05，
Published：20 May 2019
- 稿件说明：
移动端阅览
Shuainan CUI, Zongju PENG, Wenhui ZOU, et al. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion[J]. Telecommunications science, 2019, 35(5): 104-112.
Shuainan CUI, Zongju PENG, Wenhui ZOU, et al. Quality assessment of synthetic viewpoint stereo image with multi-feature fusion[J]. Telecommunications science, 2019, 35(5): 104-112. DOI： 10.11959/j.issn.1000-0801.2019070.
摘要
提出一种多特征融合的方法，该方法融合了合成视点立体图像中失真区域、失真边缘和奇异值的特征。首先，利用视差和阈值得到符合人眼感知的失真区域，计算该区域的平均结构相似度；然后，提取合成视点边缘图像中符合人眼感知的失真边缘，计算在该区域的平均结构相似度；接着，计算原始图像与失真图像奇异值差异；最后，将上述特征值进行融合得到最终的客观质量分数。在合成视点立体图像库上进行测试，实验结果表明，Pearson 线性相关系数和Spearman相关系数均高于0.86。与现有评价方法相比，能更准确地反映合成视点立体图像质量。
Abstract
A multi-feature fusion method was proposed
the features of the distortion areas
the distortion edges and the singular value were fused.Firstly
the distortion areas corresponding to the human eyes were obtained by using the parallax and the threshold
and then the average structural similarity in these areas was calculated.Secondly
the distorted edges in the synthetic viewpoint edge image were extracted
and then the average structural similarity was calculated.Thirdly
the difference between the original image and the distorted image singular value was calculated.Finally
the three features were fused to obtain the final objective quality score.The experiment was carried out on the synthetic viewpoint stereo image library.The experimental results show that the Pearson linear correlation coefficient and the Spearman correlation coefficient are both higher than 0.86.Compared with the existing assessment methods
it can better reflect the quality of synthetic viewpoint stereo images.
关键词
Keywords
references
林金桐 , 许晓东 . 第五代移动互联网 [J ] . 电信科学 , 2015 , 31 ( 5 ): 1 - 8 .
LIN J T , XU X D . The 5th generation of mobile internet [J ] . Telecommunications Science , 2015 , 31 ( 5 ): 1 - 8 .
高峰 , 王丽芳 , 朱文涛 . 移动通信天线的未来技术发展 [J ] . 电信科学 , 2016 , 32 ( Z1 ): 78 - 82 .
GAO F , WANG L F , ZHU W T . Futher technology development of mobile communication antenna [J ] . Telecommunications Science , 2016 , 32 ( Z1 ): 78 - 82 .
ZHI J , TAMMAM T , XIAO J , et al . Multiview video plus depth transmission via virtual-view-assisted complementary down/upsampling [J ] . Eurasip Journal on Image ＆ Video Processing , 2016 ( 1 ): 19 - 19 .
SANDIC-STANKOVIC D , KUKOLI D , CALLET P L . DIBR synthesized image quality assessment based on morphological wavelets [C ] // International Workshop on Quality of Multimedia Experience,May 26-29,2015,Pylos Nestoras . Piscataway:IEEE Press , 2015 : 1 - 4 .
STANKOVIC D S , KUKOLJ D , CALLET P L . DIBR synthesized image quality assessment based on morphological pyramids [C ] // 2015 International Workshop on Quality of Multimedia Experience,May 26,2015,Pylos-Nestoras,Greece . Piscataway:IEEE Press , 2015 : 1 - 4 .
MIILLERK , SCHWARZ H , MARPE D , et al . 3D high- efficiency video coding for multi-view video and depth data [J ] . IEEE Transactions on Image Processing , 2013 , 22 ( 9 ): 3366 - 3378 .
ZHU L , ZHANG Y , WANG S , et al . Convolutional neural network based synthesized view quality enhancement for 3D video coding [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 11 ): 5365 - 5377 .
TECH G , SCHWARZ H , MIILLER K , et al . 3D video coding using the synthesized view distortion change [C ] // 2012 IEEE International Conference on Multimedia and Expo,July 9-13,2012,Melbourne,VIC,Australia . Piscataway:IEEE Press , 2012 : 25 - 28 .
WANG Z , BOVIK A C , SHEIKH H R , et al . Image quality assessment:from error visibility to structural similarity [J ] . IEEE Transactions on Image Processing , 2004 , 13 ( 4 ): 600 - 612 .
BENOIT A , CALLET P L , CAMPISI P , et al . Using disparity for quality assessment of stereoscopic images [C ] // IEEE International Conference on Image Processing,Oct 12-15,2008,San Diego,CA,USA . Piscataway:IEEE Press , 2008 : 389 - 392 .
CHEN M J , SU C C , KWON D K , et al . Full-reference quality assessment of stereopairs accounting for rivalry [J ] . Signal Processing Image Communication , 2013 , 28 ( 9 ): 1143 - 1155 .
ZHOU Y , LI L , GU K , et al . DIBR-synthesized image quality assessment via statistics of edge intensity and orientation [J ] . Transactions on Information ＆ Systems , 2017 , 100 ( 8 ): 1929 - 1933 .
BATTISITI F , BOSC E , CARLI M , et al . Objective image quality assessment of 3D synthesized views [J ] . Signal Processing Image Communication , 2015 , 30 ( C ): 78 - 88 .
BOSC E , PEPION R , CALLET P L , et al . Towards a new quality metric for 3D synthesized view assessment [J ] . IEEE Journal of Selected Topics in Signal Processing , 2011 , 5 ( 7 ): 1332 - 1343 .
GU K , JAKHETIYA V , QIAO J F , et al . Model-based referenceless quality metric of 3D synthesized images using local image description [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 1 ): 394 - 405 .
TIAN S , ZHANG L , MORIN L , et al . NIQSV+:a no-reference synthesized view quality assessment metric [J ] . IEEE Transactions on Image Processing , 2018 , 27 ( 4 ): 1652 - 1664 .
YONG J J , KIM H G , YONG M R . Critical binocular asymmetry measure for the perceptual quality assessment of synthesized stereo 3D images in view synthesis [J ] . IEEE Transactions on Circuits ＆ Systems for Video Technology , 2016 , 26 ( 7 ): 1201 - 1214 .
ZHAO Y , CHEN Z , ZHU C , et al . Binocular just-noticeabledifference model for stereoscopic images [J ] . IEEE Signal Processing Letters , 2010 , 18 ( 1 ): 19 - 22 .
SHANYDERMAN A , GUSEV A , ESKICIOGLU A M . An SVD-based grayscale image quality measure for local and global assessment [J ] . IEEE Transactions on Image Processing , 2006 , 15 ( 2 ): 422 - 429 .
IVY LAB Stereoscopic 3D image database for quality assessment of synthesized stereoimages [EB ] . 2014 .
Middlebury stereo datasets [Z ] .
0
Views
388
下载量
0
CSCD
- L-PDFDownload
- XMLDownload
- Meta-XMLDownload
- BibTeXDownload
- EndnoteDownload
- RefMan Download
- NoteExpressDownload
- NoteFirstDownload
Publicity Resources
Related Articles
Related Author
Related Institution
- Technical support is provided by Beijing Founder electronics co., LTD 京ICP备09064830号-19
京公网安备11010802024621 - It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
- Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
- Total Visits：69997 Visits Today：52