采用圆周局部三值模式纹理特征的合成语音检测方法

金宏辉; 简志华; 杨曼; 吴超

doi:10.11959/j.issn.1000-0801.2023121

您当前的位置：

首页 >

文章列表页 >

采用圆周局部三值模式纹理特征的合成语音检测方法

研究与开发 | 更新时间：2024-06-05

- 采用圆周局部三值模式纹理特征的合成语音检测方法
- Synthetic speech detection method using texture feature based on circumferential local ternary pattern
- 电信科学 2023年39卷第6期页码：85-95
- 作者机构：
  
  1. 杭州电子科技大学通信工程学院，浙江杭州 310018
  2. 浙江省数据存储传输及应用技术研究重点实验室，浙江杭州 310018
- 作者简介：
  
  [ "金宏辉（1999- ），男，杭州电子科技大学通信工程学院硕士生，主要研究方向为伪装语音检测" ]
  [ "简志华（1978- ），男，杭州电子科技大学通信工程学院副教授、硕士生导师，浙江省数据存储传输及应用技术研究重点实验室教师，主要研究方向为语音转换、伪装语音检测、语音中的隐私保护等" ]
  [ "杨曼（2000- ），女，杭州电子科技大学通信工程学院硕士生，主要研究方向为伪装语音检测" ]
  [ "吴超（1988- ），男，杭州电子科技大学通信工程学院讲师，主要研究方向为导航信号处理及欺骗干扰检测" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(61201301);国家自然科学基金资助项目;The National Natural Science Foundation of China(61772166);国家自然科学基金资助项目;The National Natural Science Foundation of China(61901154)
- DOI：10.11959/j.issn.1000-0801.2023121
  中图分类号： TP391.42
- 网络出版日期：2023-06，
  
  纸质出版日期：2023-06-20
- 稿件说明：
移动端阅览
金宏辉, 简志华, 杨曼, 等. 采用圆周局部三值模式纹理特征的合成语音检测方法[J]. 电信科学, 2023,39(6):85-95.

Honghui JIN, Zhihua JIAN, Man YANG, et al. Synthetic speech detection method using texture feature based on circumferential local ternary pattern[J]. Telecommunications science, 2023, 39(6): 85-95.
金宏辉, 简志华, 杨曼, 等. 采用圆周局部三值模式纹理特征的合成语音检测方法[J]. 电信科学, 2023,39(6):85-95. DOI： 10.11959/j.issn.1000-0801.2023121.

Honghui JIN, Zhihua JIAN, Man YANG, et al. Synthetic speech detection method using texture feature based on circumferential local ternary pattern[J]. Telecommunications science, 2023, 39(6): 85-95. DOI： 10.11959/j.issn.1000-0801.2023121.

摘要

为了进一步提高合成语音检测的准确率，提出了一种采用圆周局部三值模式（CLTP）纹理特征的合成语音检测方法。该方法利用圆周局部三值模式提取语谱图中的纹理信息并作为语音的特征表示，采用深度残差网络作为后端分类器来判决语音真伪。实验结果表明，在ASVspoof 2019数据集上，与传统的常量Q倒谱系数（CQCC）和线性预测倒谱系数（LPCC）两种特征相比，该方法在等错误率（EER）上分别降低了54.29%和 2.15%，与局部三值模式（LTP）纹理特征相比，该方法在等错误率上也降低了 17.14%。圆周局部三值模式由于综合考虑了邻域内中心像素与周边像素之间以及各周边像素之间的差异，更加全面地获取了语谱图的纹理信息，提高了合成语音检测的准确率。

Abstract

In order to further improve the accuracy of synthetic speech detection

a synthetic speech detection method using texture feature based on circumferential local ternary pattern (CLTP) was proposed.The method extracted the texture information from the speech spectrogram using the CLTP and applied it as the feature representation of speech.The deep residual network was employed as the back-end classifier to determine the real or spoofing speech.The experimental results demonstrate that

on the ASVspoof 2019 dataset

the proposed method reduces the equal error rate (EER) by 54.29% and 2.15% respectively

compared with the traditional constant Q cepstral coefficient (CQCC) and linear predictive cepstral coefficient (LPCC)

and reduced the EER by 17.14% compared with the local ternary pattern(LTP) texture features.The CLTP comprehensively takes into account the differences between the central and peripheral pixels in the neighborhood and between each peripheral pixel.Then it can acquire more texture information from the speech spectrogram

and improve the accuracy of synthetic speech detection.

关键词

Keywords

references

DHANUSH B K , SUPARNA S , AARTHY R , et al . Factor analysis methods for joint speaker verification and spoof detection [C ] // Proceedings of 2017 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2017 : 5385 - 5389 .

MO Y C , WANG S L . Multi-task learning improves synthetic speech detection [C ] // Proceedings of ICASSP 2022 - 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2022 : 6392 - 6396 .

LI C T , YANG F R , YANG J . The role of long-term dependency in synthetic speech detection [J ] . IEEE Signal Processing Letters , 2022 , 29 : 1142 - 1146 .

PAUL D , PAL M , SAHA G . Spectral features for synthetic speech detection [J ] . IEEE Journal of Selected Topics in Signal Processing , 2017 , 11 ( 4 ): 605 - 617 .

HIMAWAN I , VILLAVICENCIO F , SRIDHARAN S , et al . Deep domain adaptation for anti-spoofing in speaker verification systems [J ] . Computer Speech ＆ Language , 2019 , 58 : 377 - 402 .

梁瑞刚 , 吕培卓 , 赵月 , 等 . 视听觉深度伪造检测技术研究综述 [J ] . 信息安全学报 , 2020 , 5 ( 2 ): 1 - 17 .

LIANG R G , LYU P Z , ZHAO Y , et al . A survey of audiovisual deepfake detection techniques [J ] . Journal of Cyber Security , 2020 , 5 ( 2 ): 1 - 17 .

YANG J C , DAS R K , LI H Z . Extended constant-Q cepstral coefficients for detection of spoofing attacks [C ] // Proceedings of 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC) . Piscataway:IEEE Press , 2019 : 1024 - 1029 .

SRINIVAS K , DAS R K , PATIL H A . Combining phase-based features for replay spoof detection system [C ] // Proceedings of 2018 11th International Symposium on Chinese Spoken Language Processing (ISCSLP) . Piscataway:IEEE Press , 2019 : 151 - 155 .

任延珍 , 刘晨雨 , 刘武洋 , 等 . 语音伪造及检测技术研究综述 [J ] . 信号处理 , 2021 , 37 ( 12 ): 2412 - 2439 .

REN Y Z , LIU C Y , LIU W Y , et al . A survey on speech forgery and detection [J ] . Journal of Signal Processing , 2021 , 37 ( 12 ): 2412 - 2439 .

YANG J C , DAS R K . Improving anti-spoofing with octave spectrum and short-term spectral statistics information [J ] . Applied Acoustics , 2020 ,157:107017.

徐剑 , 简志华 , 于佳祺 , 等 . 采用完整局部二进制模式的伪装语音检测 [J ] . 电信科学 , 2021 , 37 ( 5 ): 91 - 99 .

XU J , JIAN Z H , YU J Q , et al . Completed local binary pattern based speech anti-spoofing [J ] . Telecommunications Science , 2021 , 37 ( 5 ): 91 - 99 .

ALEGRE F , AMEHRAYE A , EVANS N . A one-class classification approach to generalised speaker verification spoofing countermeasures using local binary patterns [C ] // Proceedings of 2013 IEEE Sixth International Conference on Biometrics:Theory,Applications and Systems (BTAS) . Piscataway:IEEE Press , 2014 : 1 - 8 .

JAVED A , MALIK K M , MALIK H , et al . Voice spoofing detector:a unified anti-spoofing framework [J ] . Expert Systems With Applications , 2022 ,198:116770.

ZHAO X C , LIN Y P , HEIKKILÄ J . Dynamic texture recognition using volume local binary count patterns with an application to 2D face spoofing detection [J ] . IEEE Transactions on Multimedia , 2018 , 20 ( 3 ): 552 - 566 .

ZHANG Y J , LI S H , WANG S L , et al . Revealing the traces of Median filtering using high-order local ternary patterns [J ] . IEEE Signal Processing Letters , 2014 , 21 ( 3 ): 275 - 279 .

ZHENG Z H , XU B C , JU J P , et al . Circumferential local ternary pattern:new and efficient feature descriptors for anti-counterfeiting pattern identification [J ] . IEEE Transactions on Information Forensics and Security , 2022 , 17 : 970 - 981 .

于佳祺 , 简志华 , 徐嘉 , 等 . 基于联合特征与随机森林的伪装语音检测 [J ] . 电信科学 , 2022 , 38 ( 6 ): 91 - 99 .

YU J Q , JIAN Z H , XU J , et al . Spoofing speech detection algorithm based on joint feature and random forest [J ] . Telecommunications Science , 2022 , 38 ( 6 ): 91 - 99 .

梁超 , 高勇 . 一种利用 SE-Res2Net 的合成语音检测系统 [J ] . 无线电工程 , 2022 , 52 ( 9 ): 1560 - 1565 .

LIANG C , GAO Y . A synthetic speech detection system using SE-Res2Net [J ] . Radio Engineering , 2022 , 52 ( 9 ): 1560 - 1565 .

MONTEIRO J , ALAM J , FALK T H . Generalized end-to-end detection of spoofing attacks to automatic speaker recognizers [J ] . Computer Speech ＆ Language , 2020 ,63:101096.

ZHANG Y , JIANG F , DUAN Z Y . One-class learning towards synthetic voice spoofing detection [J ] . IEEE Signal Processing Letters , 2021 , 28 : 937 - 941 .

WANG X , YAMAGISHI J , TODISCO M , et al . ASVspoof 2019:a large-scale public database of synthesized,converted and replayed speech [J ] . Computer Speech ＆ Language , 2020 ,64:101114.

KINNUNEN T , DELGADO H , EVANS N , et al . Tandem assessment of spoofing countermeasures and automatic speaker verification:fundamentals [J ] . IEEE/ACM Transactions on Audio,Speech,and Language Processing , 2020 , 28 : 2195 - 2210 .

MALIK K M , JAVED A , MALIK H , et al . A light-weight replay detection framework for voice controlled IoT devices [J ] . IEEE Journal of Selected Topics in Signal Processing , 2020 , 14 ( 5 ): 982 - 996 .

WU Z Z , DAS R K , YANG J C , et al . Light convolutional neural network with feature genuinization for detection of synthetic speech attacks [C ] // Proceedings of Interspeech 2020 .[S.l.:s.n. ] , 2020 : 1101 - 1105 .

TAK H , PATINO J , TODISCO M , et al . End-to-end anti-spoofing with RawNet2 [C ] // Proceedings of ICASSP 2021-2021 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2021 : 6369 - 6373 .

王锦阳 , 华光 , 黄双 . 基于注意力机制的端到端合成语音检测 [J ] . 信号处理 , 2022 , 38 ( 9 ): 1975 - 1987 .

WANG J Y , HUA G , HUANG S . End-to-end synthetic speech detection based on attention mechanism [J ] . Journal of Signal Processing , 2022 , 38 ( 9 ): 1975 - 1987 .

浏览量

187

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

采用自监督对比学习的合成伪造语音检测方法

采用局部相位量化的合成语音检测方法

基于中心对称局部二值模式的合成伪装语音检测方法