A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution

Zhen YE; Guoxiang WANG; Junfeng SONG; Haokun LIU; Tiansong LI

doi:10.11959/j.issn.1000-0801.2023132

您当前的位置：

首页 >

文章列表页 >

A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution

Research and Development | 更新时间：2024-06-05

- A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution
- Telecommunications Science Vol. 39, Issue 7, Pages: 99-108(2023)
- 作者机构：
  
  1. 丽水学院，浙江丽水 323000
  2. 重庆师范大学，重庆 401331
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2023132
  CLC： TP391
- Published Online：2023-07，
  
  Published：20 July 2023
- 稿件说明：
移动端阅览
Zhen YE, Guoxiang WANG, Junfeng SONG, et al. A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution[J]. Telecommunications science, 2023, 39(7): 99-108.
DOI：

Zhen YE, Guoxiang WANG, Junfeng SONG, et al. A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution[J]. Telecommunications science, 2023, 39(7): 99-108. DOI： 10.11959/j.issn.1000-0801.2023132.

摘要

最近，联合视频探索工作组（JVET）将通用视频编码（VVC）作为新一代视频编码标准，它利用复杂的四叉树加多类型树（QTMTT）划分结构有效地提升了编码性能，但也导致编码复杂度急剧攀升，大幅地增加了编码时间。为解决上述问题，提出了一种基于深度可分离卷积的VVC帧内编码快速块划分算法，将编码单元（CU）的原始像素值作为输入，利用轻量化的深度可分离卷积神经网络提取CU纹理信息特征指导CU的划分模式选择，实现精准的划分模式预测。该方案通过跳过低概率的划分模式，减少CU划分模式的遍历，大幅地降低编码器的复杂度。实验结果表明，所提算法在VTM 15.2平台上实现了18%～48%的编码时间节省，仅仅带来了平均0.15%的性能损失，并且轻量化的深度可分离卷积计算带来的额外复杂性也可以忽略不计。

Abstract

The joint video exploration team (JVET) proposed versatile video coding (VVC) as a new video coding standard

and its quadtree plus multi-type tree (QTMTT) partition structure brings effective coding performance improvements.However

it brings about a sharp increase in encoding complexity

which greatly increases the encoding time.In order to solve the above problems

a fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution was proposed.The pixel of coding unit (CU) was used as input

and the texture information feature of CU was extracted through depth-separable convolution.Therefore

accurate partition mode prediction was realized in the QTMT structure in VVC

and the complexity of the encoder was reduced by skipping low-probability partition modes.Experimental results show that the proposed algorithm saves 18% to 48% of encoding time on the VTM 15.2

and only brings an average performance loss of 0.15%.And the additional complexity brought by the lightweight depthwise separable convolution calculation is also negligible.

关键词

Keywords

references

SULLIVAN G J , OHM J R , HAN W J , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

BROSS B , WANG Y K , YE Y , et al . Overview of the versatile video coding (VVC) standard and its applications [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2021 , 31 ( 10 ): 3736 - 3764 .

万帅 , 杨付正 . 新一代高效视频编码H.265/HEVC:原理、标准与实现 [M ] . 北京 : 电子工业出版社 , 2014 .

WAN S , YANG F Z . New generation efficient video coding H.265/HEVC:principles,standards,and implementation [M ] . Beijing : Publishing House of Electronics Industry , 2014 .

XIANG M . CE3:CCLM/MDLM using simplified coefficients derivation method [EB ] . 2018 .

CHEN J , YE Y , KIM S , et al . Algorithm description for versatile video coding and test model 5 (VTM 5) [EB ] . 2019 .

JIANLE C . Algorithm description for versatile video coding and test model 4 (VTM 4) [EB ] . 2019 .

SANTIAGO D L H . CE3:Intra sub-partitions coding mode [EB ] . 2019 .

JONATHAN P , BJÖRN S . CE3:affine linear weighted intra prediction [EB ] . 2019 .

卢嘉彬 , 彭宗举 , 束争杰 , 等 . 面向 VVC 帧内编码的快速CU 划分和角度模式决策 [J ] . 光电子·激光 , 2021 , 32 ( 11 ): 1171 - 1179 .

LU J B , PENG Z J , SHU Z J , et al . Fast CU partition and angle mode decision for VVC intra coding [J ] . Journal of Optoelectronics · Laser , 2021 , 32 ( 11 ): 1171 - 1179 .

陶浩然 , 路锦正 , 李意弦 . 一种VVC帧内编码单元快速划分算法 [J ] . 小型微型计算机系统 , 2021 , 42 ( 7 ): 1470 - 1474 .

TAO H R , LU J Z , LI Y X . Fast division algorithm of VVC intra-coding unit [J ] . Journal of Chinese Computer Systems , 2021 , 42 ( 7 ): 1470 - 1474 .

TANG N , CAO J , LIANG F , et al . Fast CTU partition decision algorithm for VVC intra and inter coding [C ] // Proceedings of 2019 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS) . Piscataway:IEEE Press , 2020 : 361 - 364 .

DONG X C , SHEN L Q , YU M , et al . Fast intra mode decision algorithm for versatile video coding [J ] . IEEE Transactions on Multimedia , 2021 , 24 : 400 - 414 .

LI Y , YANG G B , SONG Y , et al . Early intra CU size decision for versatile video coding based on a tunable decision model [J ] . IEEE Transactions on Broadcasting , 2021 , 67 ( 3 ): 710 - 720 .

熊丹祺 , 高伟 , 滕国伟 . 基于决策树的 H.266/VVC 帧内预测CU快速划分算法 [J ] . 工业控制计算机 , 2021 , 34 ( 7 ): 88 - 90 , 92 .

XIONG D Q , GAO W , TENG G W . Decision tree accelerated CU partition algorithm for intra prediction in H.266/VVC [J ] . Industrial Control Computer , 2021 , 34 ( 7 ): 88 - 90 , 92 .

ZHAO J C , WU A B , ZHANG Q W . SVM-based fast CU partition decision algorithm for VVC intra coding [J ] . Electronics , 2022 , 11 ( 14 ): 2147 .

WU G Q , HUANG Y , ZHU C , et al . SVM based fast CU partitioning algorithm for VVC intra coding [C ] // Proceedings of 2021 IEEE International Symposium on Circuits and Systems (ISCAS) . Piscataway:IEEE Press , 2021 : 1 - 5 .

LIU X G , LI Y Y , LIU D Y , et al . An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2019 , 29 ( 1 ): 144 - 155 .

ZHANG S P , FENG S X , CHEN J W , et al . A GCN-based fast CU partition method of intra-mode VVC [J ] . Journal of Visual Communication and Image Representation , 2022 ,88:103621.

TECH G , PFAFF J , SCHWARZ H , et al . Fast partitioning for VVC intra-picture encoding with a CNN minimizing the rate-distortion-time cost [C ] // Proceedings of 2021 Data Compression Conference (DCC) . Piscataway:IEEE Press , 2021 : 3 - 12 .

WU S L , SHI J , CHEN Z B . HG-FCN:hierarchical grid fully convolutional network for fast VVC intra coding [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2022 , 32 ( 8 ): 5638 - 5649 .

FANG J T , LIU B H , CHANG P C . Fast coding unit partitioning algorithms for versatile video coding intra coding [J ] . Journal of Visual Communication and Image Representation , 2022 ,87:103542.

DANG-NGUYEN D T , PASQUINI C , CONOTTER V , et al . RAISE:a raw images dataset for digital image forensics [C ] // Proceedings of the 6th ACM Multimedia Systems Conference . New York:ACM Press , 2015 : 219 - 224 .

Views

305

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

GMTBLC: a deep learning-based bi-modal network traffic classification method

Research on antenna dip angle recognition method based on improved YOLOv5

Mixed signal modulation recognition method based on temporal depth residual shrinkage network

A fast VVC intra-coding algorithm based on graph neural network and statistical analysis

A VVC intra coding method based on fast partition for coding unit

Related Author

WEI Debin

JIANG Qinlong

WEN Jinglong

WANG Xinrui

ZHANG Ning

PAN Feng

GENG Lujing

CHEN Zuhao

Related Institution

School of Information Engineering, Dalian University

China Mobile Group Design Institute Co., Ltd.

China Mobile Group Co., Ltd.

The 63rd Research Institute, National University of Defense Technology

School of Electronic and Information Engineering, Nanjing University of Information Science and Technology

⁰