基于上下文信息与注意力特征的欺骗语音检测

陈佳; 章坚武; 张浙亮

doi:10.11959/j.issn.1000-0801.2023006

您当前的位置：

首页 >

文章列表页 >

基于上下文信息与注意力特征的欺骗语音检测

研究与开发 | 更新时间：2024-06-05

- 基于上下文信息与注意力特征的欺骗语音检测
- Spoof speech detection based on context information and attention feature
- 电信科学 2023年39卷第2期页码：92-102
- 作者机构：
  
  1. 杭州电子科技大学，浙江杭州 310018
  2. 浙江宇视科技有限公司，浙江杭州 310051
- 作者简介：
  
  [ "陈佳（2000- ），女，杭州电子科技大学通信工程学院硕士生，主要研究方向为语音检测与人工智能等" ]
  [ "章坚武（1961- ），男，博士，杭州电子科技大学通信工程学院教授、博士生导师，中国电子学会高级会员，浙江省通信学会常务理事，主要研究方向为移动通信、多媒体信号处理与人工智能、通信网络与信息安全" ]
  [ "张浙亮（1969- ），男，博士，浙江宇视科技有限公司副总裁，主要研究方向为人工智能、人力资源等" ]
- 基金信息：
  
  国家自然科学基金资助项目;The National Natural Science Foundation of China(U1866209);国家自然科学基金资助项目;The National Natural Science Foundation of China(61772162)
- DOI：10.11959/j.issn.1000-0801.2023006
  中图分类号： TN912.3
- 网络出版日期：2023-02，
  
  纸质出版日期：2023-02-20
- 稿件说明：
移动端阅览
陈佳, 章坚武, 张浙亮. 基于上下文信息与注意力特征的欺骗语音检测[J]. 电信科学, 2023,39(2):92-102.

Jia CHEN, Jianwu ZHANG, Zheliang ZHANG. Spoof speech detection based on context information and attention feature[J]. Telecommunications science, 2023, 39(2): 92-102.
陈佳, 章坚武, 张浙亮. 基于上下文信息与注意力特征的欺骗语音检测[J]. 电信科学, 2023,39(2):92-102. DOI： 10.11959/j.issn.1000-0801.2023006.

Jia CHEN, Jianwu ZHANG, Zheliang ZHANG. Spoof speech detection based on context information and attention feature[J]. Telecommunications science, 2023, 39(2): 92-102. DOI： 10.11959/j.issn.1000-0801.2023006.

摘要

随着语音合成和语音转换技术的快速发展，欺骗语音检测方法仍存在欺骗检测准确率低、通用性差等问题。因此，提出一种基于上下文信息与注意力特征的端到端的欺骗检测方法。该方法基于深度残差收缩网络（DRSN），利用双分支上下文信息协调融合模块（DCCM）聚集丰富的上下文信息，融合基于协调时频注意力机制（CTFA）的特征以获得具有上下文信息的跨维度交互特征，从而最大化捕获伪影的潜力。与最佳基线系统相比，在ASVspoof 2019 LA数据集中，所提方法在EER和t-DCF性能指标上分别降低68%和65%；在ASVspoof 2021 LA数据集中，所提方法的EER和t-DCF分别为4.81和0.311 5，分别降低48%和10%。实验结果表明，所提方法能有效提高欺骗语音检测的准确率和泛化能力。

Abstract

With the rapid development of speech synthesis and speech conversion technology

methods of spoof speech detection still have problems such as low spoof detection accuracy and poor generality.Therefore

an end-to-end spoof detection method based on context information and attention feature was proposed.Based on deep residual shrinkage network (DRSN)

the proposed method used the dual-branch context information coordination fusion module (DCCM) to aggregate rich context information

and fused features based on coordinate time-frequency attention (CTFA) to obtain cross-dimensional interaction features with context information

thus maximizing the potential of capturing artifacts.Compared with the best baseline system

in the ASVspoof 2019 LA dataset

the proposed method had reduced the EER and t-DCF performance indicators by 68% and 65% respectively

in the ASVspoof 2021 LA dataset

the EER and t-DCF of the proposed method were 4.81 and 0.311 5 and dropped by 48% and 10% separately.The experimental results show that this method can effectively improve the accuracy and generalization ability of spoof speech detection.

关键词

Keywords

references

KINNUNEN T , LI H . An overview of text-independent speaker recognition:from features to supervectors [J ] . Speech communication , 2010 , 52 ( 1 ): 12 - 40 .

SINGH N , AGRAWAL A , KHAN R A . Voice biometric:a technology for voice based authentication [J ] . Advanced Science,Engineering and Medicine , 2018 , 10 ( 7-8 ): 754 - 759 .

MITTAL A , DUA M . Automatic speaker verification systems and spoof detection techniques:review and analysis [J ] . International Journal of Speech Technology , 2021 ( 25 ): 1 - 30 .

徐剑 , 简志华 , 于佳祺 , 等 . 采用完整局部二进制模式的伪装语音检测 [J ] . 电信科学 , 2021 , 37 ( 5 ): 91 - 99 .

XU J , JIAN Z H , YU J Q , et al . Completed local binary pattern based speech anti-spoofing [J ] . Telecommunications Science , 2021 , 37 ( 5 ): 91 - 99 .

于佳祺 , 简志华 , 徐嘉 , 等 . 基于联合特征与随机森林的伪装语音检测 [J ] . 电信科学 , 2022 , 38 ( 6 ): 91 - 99 .

YU J Q , JIAN Z H , XU J , et al . Spoofing speech detection algorithm based on joint feature and random forest [J ] . Telecommunications Science , 2022 , 38 ( 6 ): 91 - 99 .

TAK H , PATINO J , TODISCO M , et al . End-to-end anti-spoofing with RawNet2 [C ] // Proceedings of 2021 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2021 : 6369 - 6373 .

GE W Y , PATINO J , TODISCO M , et al . Raw differentiable architecture search for speech deep fake and spoofing detection [EB ] . 2021 .

KANG W H , ALAM J , FATHAN A , et al . Attentive activation function for improving end-to-end spoofing countermeasure systems [EB ] . 2022 .

CHEN D S , LI J , XU K , et al . AReLU:attention-based rectified linear unit [EB ] . 2020 .

WANG X , YAMAGISHI J , TODISCO M , et al . ASVspoof 2019:a large-scale public data base of synthesized,converted and replayed speech [J ] . Computer Speech ＆ Language , 2020 , 64 : 101 - 114 .

YAMAGISHI J , WANG X , TODISCO M , et al . ASVspoof 2021:accelerating progress in spoofed and deep fake speech detection [EB ] . 2021 .

LING H F , HUANG L C , HUANG J R , et al . Attention-based convolutional neural network for ASV spoofing detection [C ] // Proceedings of 2021 INTERSPEECH .[S.l.:s.n. ] , 2021 : 4289 - 4293 .

ZHOU Y , ZHANG J W , ZHANG P G . Spoof speech detection based on raw cross-dimension interaction attention network [C ] // Proceedings of 2022 Chinese Conference on Biometric Recognition . Cham:Springer , 2022 : 621 - 629 .

HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2016 : 770 - 778 .

HUA G , TEOH A B J , ZHANG H . Towards end-to-end synthetic speech detection [J ] . IEEE Signal Processing Letters , 2021 , 28 : 1265 - 1269 .

SZEGEDY C , LIU W , JIA Y , et al . Going deeper with convolutions [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2015 : 1 - 9 .

ZHAO M H , ZHONG S S , FU X Y , et al . Deep residual shrinkage networks for fault diagnosis [J ] . IEEE Transactions on Industrial Informatics , 2019 , 16 ( 7 ): 4681 - 4690 .

周晔 , 章坚武 , 程继承 . 面向复杂声学环境的伪装语音检测 [J ] . 传感技术学报 , 2022 , 35 ( 10 ): 1355 - 1362 .

ZHOU Y , ZHANG J W , CHENG J C . Speech anti-spoofing for complex acoustic environments [J ] . Chinese Journal of Sensors and Actuators , 2022 , 35 ( 10 ): 1355 - 1362 .

王金华 , 应娜 , 朱辰都 , 等 . 基于语谱图提取深度空间注意特征的语音情感识别算法 [J ] . 电信科学 , 2019 , 35 ( 7 ): 100 - 108 .

WANG J H , YING N , ZHU C D , et al . Speech emotion recognition algorithm based on spectrogram feature extraction of deep space attention feature [J ] . Telecommunications Science , 2019 , 35 ( 7 ): 100 - 108 .

LEI S , ZHOU Y X , CHEN L Y , et al . Towards expressive speaking style modelling with hierarchical context information for mandarin speech synthesis [C ] // Proceedings of the 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2022 : 7922 - 7926 .

HU J , SHEN L , ALBANIE S . Squeeze-and-excitation networks [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 7132 - 7141 .

WOO S , PARK J , LEE J Y , et al . CBAM:convolutional block attention module [C ] // Proceedings of the 2018 European Conference on Computer Vision .[S.l.:s.n. ] , 2018 : 3 - 19 .

HOU Q B , ZHOU D Q , FENG J S . Coordinate attention for efficient mobile network design [C ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recongnition . Piscataway:IEEE Press , 2021 : 13713 - 13722 .

DAI Y M , GIESEKE F , OEHMCKE S , et al . Attentional feature fusion [C ] // Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision . Piscataway:IEEE Press , 2021 : 3560 - 3569 .

LUO A W , LI E L , LIU Y L , et al . A capsule network based approach for detection of audio spoofing attacks [C ] // Proceed ings of 2021 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2021 : 6359 - 6363 .

LI X , WU X X , LU H , et al . Channel-wise gated Res2Net:towards robust detection of synthetic speech attacks [C ] // Proceedings of 2021 INTERSPEECH .[S.l.:s.n. ] , 2021 : 4314 - 4318 .

ZHANG Y , JIANG F , DUAN Z Y . One-class learning towards synthetic voice spoofing detection [J ] . IEEE Signal Processing Letters , 2021 , 28 : 937 - 941 .

COHEN A , RIMON I , AFLALO E , et al . A study on data augmentation in voice anti-spoofing [J ] . Speech Communication , 2022 , 141 : 56 - 67 .

DAS R K , . Known-unknown data augmentation strategies for detection of logical access,physical access and speech deep fake attacks:ASV spoof 2021 [C ] // Proceedings of 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge .[S.l.:s.n. ] , 2021 : 29 - 36 .

TAK H , KAMBLE M , PATINO J , et al . Raw boost:a raw data boosting and augmentation method applied to automatic speaker verification anti-spoofing [C ] // Proceedings of 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2022 : 6382 - 6386 .

CÁCERES J , FONT R , GRAU T . The biometric vox system for the ASVspoof 2021 challenge [C ] // Proceedings 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge .[S.l.:s.n. ] , 2021 : 68 - 74 .

PAL M , RAIKAR A , PANDA A , et al . Synthetic speech detection using meta-learning with prototypical loss [EB ] . 2022 .

浏览量

335

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

5G“云网边端”一体化纵深安全防护体系研究及应用

基于云网融合的5G切片专网技术方案及应用

基于5G切片专线的组网技术和实现方法

端到端确定性网络架构和关键技术

基于SDBN和BLSTM注意力融合的端到端视听双模态语音识别