一种基于深度可分离卷积的VVC帧内编码快速块划分算法

叶振; 王国相; 宋俊锋; 刘昊坤; 黎天送

doi:10.11959/j.issn.1000-0801.2023132

您当前的位置：

首页 >

文章列表页 >

一种基于深度可分离卷积的VVC帧内编码快速块划分算法

研究与开发 | 更新时间：2024-06-05

- 一种基于深度可分离卷积的VVC帧内编码快速块划分算法
- A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution
- 电信科学 2023年39卷第7期页码：99-108
- 作者机构：
  
  1. 丽水学院，浙江丽水 323000
  2. 重庆师范大学，重庆 401331
- 作者简介：
  
  [ "叶振（1984- ），男，博士，丽水学院计算机系讲师，主要研究方向为人工智能、视频图像处理" ]
  [ "王国相（1989- ），男，丽水学院助教，主要研究方向为信号处理、人工智能、视频图像处理" ]
  [ "宋俊锋（1984- ），男，丽水学院高级实验师，主要研究方向为虚拟现实、人工智能" ]
  [ "刘昊坤（1999- ），男，重庆师范大学计算机与信息科学学院硕士生，主要研究方向为H.266/VVC视频编码、深度学习" ]
  [ "黎天送（1987- ），男，博士，重庆师范大学计算机与信息科学学院讲师，主要研究方向为图像/视频编码、多视点视频编码、多媒体信号处理、人工智能" ]
- 基金信息：
  
  重庆市科技局自然基金项目;The Natural Science Foundation Project of Chongqing Science and Technology Bureau(CSTB2022NSCQ-MSX1231);重庆市教委青年项目;The Science and Technology Research Program of Chongqing Municipal Education Commission(KJQN202200519);重庆师范大学人才基金项目;The Talents Fund Project of Chongqing Normal University(21XLB031)
- DOI：10.11959/j.issn.1000-0801.2023132
  中图分类号： TP391
- 网络出版日期：2023-07，
  
  纸质出版日期：2023-07-20
- 稿件说明：
移动端阅览
叶振, 王国相, 宋俊锋, 等. 一种基于深度可分离卷积的VVC帧内编码快速块划分算法[J]. 电信科学, 2023,39(7):99-108.

Zhen YE, Guoxiang WANG, Junfeng SONG, et al. A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution[J]. Telecommunications science, 2023, 39(7): 99-108.
叶振, 王国相, 宋俊锋, 等. 一种基于深度可分离卷积的VVC帧内编码快速块划分算法[J]. 电信科学, 2023,39(7):99-108. DOI： 10.11959/j.issn.1000-0801.2023132.

Zhen YE, Guoxiang WANG, Junfeng SONG, et al. A fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution[J]. Telecommunications science, 2023, 39(7): 99-108. DOI： 10.11959/j.issn.1000-0801.2023132.

摘要

最近，联合视频探索工作组（JVET）将通用视频编码（VVC）作为新一代视频编码标准，它利用复杂的四叉树加多类型树（QTMTT）划分结构有效地提升了编码性能，但也导致编码复杂度急剧攀升，大幅地增加了编码时间。为解决上述问题，提出了一种基于深度可分离卷积的VVC帧内编码快速块划分算法，将编码单元（CU）的原始像素值作为输入，利用轻量化的深度可分离卷积神经网络提取CU纹理信息特征指导CU的划分模式选择，实现精准的划分模式预测。该方案通过跳过低概率的划分模式，减少CU划分模式的遍历，大幅地降低编码器的复杂度。实验结果表明，所提算法在VTM 15.2平台上实现了18%～48%的编码时间节省，仅仅带来了平均0.15%的性能损失，并且轻量化的深度可分离卷积计算带来的额外复杂性也可以忽略不计。

Abstract

The joint video exploration team (JVET) proposed versatile video coding (VVC) as a new video coding standard

and its quadtree plus multi-type tree (QTMTT) partition structure brings effective coding performance improvements.However

it brings about a sharp increase in encoding complexity

which greatly increases the encoding time.In order to solve the above problems

a fast block partitioning algorithm for VVC intra coding based on depthwise separable convolution was proposed.The pixel of coding unit (CU) was used as input

and the texture information feature of CU was extracted through depth-separable convolution.Therefore

accurate partition mode prediction was realized in the QTMT structure in VVC

and the complexity of the encoder was reduced by skipping low-probability partition modes.Experimental results show that the proposed algorithm saves 18% to 48% of encoding time on the VTM 15.2

and only brings an average performance loss of 0.15%.And the additional complexity brought by the lightweight depthwise separable convolution calculation is also negligible.

关键词

Keywords

references

SULLIVAN G J , OHM J R , HAN W J , et al . Overview of the high efficiency video coding (HEVC) standard [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2012 , 22 ( 12 ): 1649 - 1668 .

BROSS B , WANG Y K , YE Y , et al . Overview of the versatile video coding (VVC) standard and its applications [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2021 , 31 ( 10 ): 3736 - 3764 .

万帅 , 杨付正 . 新一代高效视频编码H.265/HEVC:原理、标准与实现 [M ] . 北京 : 电子工业出版社 , 2014 .

WAN S , YANG F Z . New generation efficient video coding H.265/HEVC:principles,standards,and implementation [M ] . Beijing : Publishing House of Electronics Industry , 2014 .

XIANG M . CE3:CCLM/MDLM using simplified coefficients derivation method [EB ] . 2018 .

CHEN J , YE Y , KIM S , et al . Algorithm description for versatile video coding and test model 5 (VTM 5) [EB ] . 2019 .

JIANLE C . Algorithm description for versatile video coding and test model 4 (VTM 4) [EB ] . 2019 .

SANTIAGO D L H . CE3:Intra sub-partitions coding mode [EB ] . 2019 .

JONATHAN P , BJÖRN S . CE3:affine linear weighted intra prediction [EB ] . 2019 .

卢嘉彬 , 彭宗举 , 束争杰 , 等 . 面向 VVC 帧内编码的快速CU 划分和角度模式决策 [J ] . 光电子·激光 , 2021 , 32 ( 11 ): 1171 - 1179 .

LU J B , PENG Z J , SHU Z J , et al . Fast CU partition and angle mode decision for VVC intra coding [J ] . Journal of Optoelectronics · Laser , 2021 , 32 ( 11 ): 1171 - 1179 .

陶浩然 , 路锦正 , 李意弦 . 一种VVC帧内编码单元快速划分算法 [J ] . 小型微型计算机系统 , 2021 , 42 ( 7 ): 1470 - 1474 .

TAO H R , LU J Z , LI Y X . Fast division algorithm of VVC intra-coding unit [J ] . Journal of Chinese Computer Systems , 2021 , 42 ( 7 ): 1470 - 1474 .

TANG N , CAO J , LIANG F , et al . Fast CTU partition decision algorithm for VVC intra and inter coding [C ] // Proceedings of 2019 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS) . Piscataway:IEEE Press , 2020 : 361 - 364 .

DONG X C , SHEN L Q , YU M , et al . Fast intra mode decision algorithm for versatile video coding [J ] . IEEE Transactions on Multimedia , 2021 , 24 : 400 - 414 .

LI Y , YANG G B , SONG Y , et al . Early intra CU size decision for versatile video coding based on a tunable decision model [J ] . IEEE Transactions on Broadcasting , 2021 , 67 ( 3 ): 710 - 720 .

熊丹祺 , 高伟 , 滕国伟 . 基于决策树的 H.266/VVC 帧内预测CU快速划分算法 [J ] . 工业控制计算机 , 2021 , 34 ( 7 ): 88 - 90 , 92 .

XIONG D Q , GAO W , TENG G W . Decision tree accelerated CU partition algorithm for intra prediction in H.266/VVC [J ] . Industrial Control Computer , 2021 , 34 ( 7 ): 88 - 90 , 92 .

ZHAO J C , WU A B , ZHANG Q W . SVM-based fast CU partition decision algorithm for VVC intra coding [J ] . Electronics , 2022 , 11 ( 14 ): 2147 .

WU G Q , HUANG Y , ZHU C , et al . SVM based fast CU partitioning algorithm for VVC intra coding [C ] // Proceedings of 2021 IEEE International Symposium on Circuits and Systems (ISCAS) . Piscataway:IEEE Press , 2021 : 1 - 5 .

LIU X G , LI Y Y , LIU D Y , et al . An adaptive CU size decision algorithm for HEVC intra prediction based on complexity classification using machine learning [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2019 , 29 ( 1 ): 144 - 155 .

ZHANG S P , FENG S X , CHEN J W , et al . A GCN-based fast CU partition method of intra-mode VVC [J ] . Journal of Visual Communication and Image Representation , 2022 ,88:103621.

TECH G , PFAFF J , SCHWARZ H , et al . Fast partitioning for VVC intra-picture encoding with a CNN minimizing the rate-distortion-time cost [C ] // Proceedings of 2021 Data Compression Conference (DCC) . Piscataway:IEEE Press , 2021 : 3 - 12 .

WU S L , SHI J , CHEN Z B . HG-FCN:hierarchical grid fully convolutional network for fast VVC intra coding [J ] . IEEE Transactions on Circuits and Systems for Video Technology , 2022 , 32 ( 8 ): 5638 - 5649 .

FANG J T , LIU B H , CHANG P C . Fast coding unit partitioning algorithms for versatile video coding intra coding [J ] . Journal of Visual Communication and Image Representation , 2022 ,87:103542.

DANG-NGUYEN D T , PASQUINI C , CONOTTER V , et al . RAISE:a raw images dataset for digital image forensics [C ] // Proceedings of the 6th ACM Multimedia Systems Conference . New York:ACM Press , 2015 : 219 - 224 .

浏览量

305

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

GMTBLC：基于深度学习的双模态网络流量分类

基于改进YOLOv5的天线下倾角识别方法研究

基于时序深度残差收缩网络的混叠信号调制识别方法

一种基于图神经网络和统计分析的VVC帧内编码快速算法

一种基于编码单元快速划分的VVC帧内编码方法