一种基于编码单元快速划分的VVC帧内编码方法

钟辉; 陆宇; 殷海兵; 黄晓峰

doi:10.11959/j.issn.1000-0801.2024196

您当前的位置：

首页 >

文章列表页 >

一种基于编码单元快速划分的VVC帧内编码方法

研究与开发 | 更新时间：2024-09-23

- 一种基于编码单元快速划分的VVC帧内编码方法
- A VVC intra coding method based on fast partition for coding unit
- 电信科学 2024年40卷第8期页码：23-33
- 作者机构：
  
  杭州电子科技大学通信工程学院，浙江杭州 310018
- 作者简介：
  
  [ "钟辉（1998- ），男，杭州电子科技大学通信工程学院硕士生，主要研究方向为视频压缩编码。" ]
  [ "陆宇（1977- ），男，博士，杭州电子科技大学通信工程学院副教授，主要研究方向为图像压缩和视频编码。" ]
  [ "殷海兵（1974- ），男，博士，杭州电子科技大学通信工程学院教授，主要研究方向为数字视频编解码。" ]
  [ "黄晓峰（1988- ），男，博士，杭州电子科技大学通信工程学院副教授，主要研究方向为图像压缩和视频编码。" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61972123);科技部重点研发课题资助项目;Ministry of Science and Technology Key Research and Development Project Funding Program(2023YFB4502800);浙江省教育厅科研项目(Y202249588)
- DOI：10.11959/j.issn.1000-0801.2024196
  中图分类号： TP393
- 收稿：2024-04-03，
  
  修回：2024-08-02，
  
  纸质出版：2024-08-20
- 稿件说明：
移动端阅览
钟辉,陆宇,殷海兵等.一种基于编码单元快速划分的VVC帧内编码方法[J].电信科学,2024,40(08):23-33.

ZHONG Hui,LU Yu,YIN Haibing,et al.A VVC intra coding method based on fast partition for coding unit[J].Telecommunications Science,2024,40(08):23-33.
钟辉,陆宇,殷海兵等.一种基于编码单元快速划分的VVC帧内编码方法[J].电信科学,2024,40(08):23-33. DOI： 10.11959/j.issn.1000-0801.2024196.

ZHONG Hui,LU Yu,YIN Haibing,et al.A VVC intra coding method based on fast partition for coding unit[J].Telecommunications Science,2024,40(08):23-33. DOI： 10.11959/j.issn.1000-0801.2024196.

摘要

相比于高效视频编码（high efficiency video coding，HEVC）标准，新一代编码标准多功能视频编码（versatile video coding，VVC）引入了很多新的技术，其中包括四叉树（quadtree，QT）和多类型树（multi-type tree，MTT）划分，MTT划分由HEVC中的QT划分延伸而来。新划分方法提高了压缩效率，但导致编码时间急剧增加。为了降低编码复杂度，提出了一种结合深度学习方法和MTT方向早期判决的快速帧内编码算法。首先使用轻量级的卷积神经网络（convolutional neural network，CNN）对QT和部分MTT进行预测划分，其余MTT则采用提前预测MTT划分方向的方法作进一步的优化。实验结果表明，所提方法能够大幅降低编码复杂度，相比于原始编码器的编码时间减少了74.3%，且只有3.3%的码率损失，性能优于对比的方法。

Abstract

Compared to the high efficiency video coding (HEVC) standard

the latest generation coding standard

versatile video coding (VVC) has introduced many new technologies

including quadtree (QT) and multi-type tree (MTT) partitioning. MTT partition is extended from QT partition in HEVC. The new partition method increases encoding complexity

leading to a sharp increase in encoding time. To reduce encoding complexity

a fast intra coding method combining deep learning methods and early decision in the MTT direction was proposed. Firstly

a light-weight convolutional neural network (CNN) network was used to predict partition for QT and partial MTT. Then

an early prediction for MTT partition direction method was adopted for fur

ther optimization of residual MTT. Experimental results show that the proposed method can significantly reduce encoding complexity

with a 74.3% reduction in encoding time compared to the original encoder with only 3.3% rate loss. Moreover

the performance

of proposed method is superior to other comparative algorithms.

关键词

Keywords

references

BROSS B , WANG Y K , YE Y , et al . Overview of the versatile video coding (VVC) standard and its applications [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2021 , 31 ( 10 ): 3736 - 3764 .

SULLIVAN G J , OHM J R , HAN W J , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

FAN Y B , CHEN J A , SUN H M , et al . A fast QTMT partition decision strategy for VVC intra prediction [J ] . IEEE Access , 2020 ( 8 ): 107900 - 107911 .

LI Y , YANG G B , SONG Y , et al . Early intra CU size decision for versatile video coding based on a tunable decision model [J ] . IEEE Transactions on Broadcasting , 2021 , 67 ( 3 ): 710 - 720 .

ZHANG Z H , FU C H , XIE K , et al . Fast VVC intra coding by skipping redundant coding block structures and unnecessary directional partition [C ] // Proceedings of the 2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval (MIPR) . Piscataway : IEEE Press , 2022 : 84 - 89 .

NI C T , LIN S H , CHEN P Y , et al . High efficiency intra CU partition and mode decision method for VVC [J ] . IEEE Access , 2022 ( 10 ): 77759 - 77771 .

LI Q , MENG H , LI Y . Texture-based fast QTMT partition algorithm in VVC intra coding [J ] . Signal, Image and Video Processing , 2023 , 17 ( 4 ): 1581 - 1589 .

ZHAO S , SHANG X W , WANG G Z , et al . A fast algorithm for intra-frame versatile video coding based on edge features [J ] . Sensors , 2023 , 23 ( 13 ): 6244 .

SI L N , ZHU W D , ZHANG Q W . Fast adaptive CU partition decision algorithm for VVC intra coding [J ] . IEEE Access , 2023 ( 11 ): 119766 - 119778 .

WU G Q , HUANG Y , ZHU C , et al . SVM based fast CU partitioning algorithm for VVC intra coding [C ] // Proceedings of the 2021 IEEE International Symposium on Circuits and Systems (ISCAS) . Piscataway : IEEE Press , 2021 : 1 - 5 .

HE Q , WU W X , LUO L , et al . Random forest based fast CU partition for VVC intra coding [C ] // Proceedings of the 2021 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) . Piscataway : IEEE Press , 2021 : 1 - 4 .

SALDANHA M , SANCHEZ G , MARCON C , et al . Configurable fast block partitioning for VVC intra coding using light gradient boosting machine [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2022 , 32 ( 6 ): 3947 - 3960 .

ABDALLAH B , BELGHITH F , ALI BEN AYED M , et al . Fast mode decision for CU coding based on CNN for the VVC standard [J ] . Journal of Electronic Imaging , 2022 , 31 ( 5 ): 053004 .

TISSIER A , HAMIDOUCHE W , VANNE J , et al . CNN oriented complexity reduction of VVC intra encoder [C ] // Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP) . Piscataway : IEEE Press , 2020 : 3139 - 3143 .

LI T Y , XU M , TANG R Z , et al . DeepQTMT: a deep learning approach for fast QTMT-based CU partition of intra-mode VVC [J ] . IEEE Transactions on Image Processing , 2021 ( 30 ): 5377 - 5390 .

ZAN Z , HUANG L L , CHEN S S , et al . Fast QTMT partition for VVC intra coding using U-net framework [C ] // Proceedings of the 2023 IEEE International Conference on Image Processing (ICIP) . Piscataway : IEEE Press , 2023 : 600 - 604 .

XU J , WU G Q , ZHU C , et al . CNN-based fast CU partitioning algorithm for VVC intra coding [C ] // Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP) . Piscataway : IEEE Press , 2022 : 2706 - 2710 .

HOANGVAN X , NGUYENQUANG S , DINHBAO M , et al . Fast QTMT for H.266/VVC intra prediction using Early-Terminated Hierarchical CNN model [C ] // Proceedings of the 2021 International Conference on Advanced Technologies for Communications (ATC) . Piscataway : IEEE Press , 2021 : 195 - 200 .

FENG A L , LIU K , LIU D , et al . Partition map prediction for fast block partitioning in VVC intra-frame coding [J ] . IEEE Transactions on Image Processing: a Publication of the IEEE Signal Processing Society , 2023 ( 32 ): 2237 - 2251 .

CHEN Z B , SHI J , LI W P . Learned fast HEVC intra coding [J ] . IEEE Transactions on Image Processing: a Publication of the IEEE Signal Processing Society , 2020 ( 29 ): 5431 - 5446 .

BOSSEN F , BOYCE J , LI X , et al . JVET common test conditions and software reference configurations for SDR video [J ] . Joint Video Experts Team (JVET) of ITU-T SG , 2019 ( 16 ): 19 - 27 .

BJONTEGAARD G . Calculation of average PSNR differences between RD-curves [J ] . ITU-T VCEG-M 33 , 2001 ( 4 ): 2 - 4 .

浏览量

491

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于移动通信网信号的人体动作识别研究

融合Gumbel-Softmax与CNN的毫米波大规模MIMO混合预编码研究

一种基于图神经网络和统计分析的VVC帧内编码快速算法

基于深度学习的6G可见光通信多址接入解调方法

基于优化卷积神经网络的车辆特征识别算法研究