Spoof speech detection based on context information and attention feature

Jia CHEN; Jianwu ZHANG; Zheliang ZHANG

doi:10.11959/j.issn.1000-0801.2023006

您当前的位置：

首页 >

文章列表页 >

Spoof speech detection based on context information and attention feature

Research and Development | 更新时间：2024-06-05

- Spoof speech detection based on context information and attention feature
- Telecommunications Science Vol. 39, Issue 2, Pages: 92-102(2023)
- 作者机构：
  
  1. 杭州电子科技大学，浙江杭州 310018
  2. 浙江宇视科技有限公司，浙江杭州 310051
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2023006
  CLC： TN912.3
- Published Online：2023-02，
  
  Published：20 February 2023
- 稿件说明：
移动端阅览
Jia CHEN, Jianwu ZHANG, Zheliang ZHANG. Spoof speech detection based on context information and attention feature[J]. Telecommunications science, 2023, 39(2): 92-102.
DOI：

Jia CHEN, Jianwu ZHANG, Zheliang ZHANG. Spoof speech detection based on context information and attention feature[J]. Telecommunications science, 2023, 39(2): 92-102. DOI： 10.11959/j.issn.1000-0801.2023006.

摘要

随着语音合成和语音转换技术的快速发展，欺骗语音检测方法仍存在欺骗检测准确率低、通用性差等问题。因此，提出一种基于上下文信息与注意力特征的端到端的欺骗检测方法。该方法基于深度残差收缩网络（DRSN），利用双分支上下文信息协调融合模块（DCCM）聚集丰富的上下文信息，融合基于协调时频注意力机制（CTFA）的特征以获得具有上下文信息的跨维度交互特征，从而最大化捕获伪影的潜力。与最佳基线系统相比，在ASVspoof 2019 LA数据集中，所提方法在EER和t-DCF性能指标上分别降低68%和65%；在ASVspoof 2021 LA数据集中，所提方法的EER和t-DCF分别为4.81和0.311 5，分别降低48%和10%。实验结果表明，所提方法能有效提高欺骗语音检测的准确率和泛化能力。

Abstract

With the rapid development of speech synthesis and speech conversion technology

methods of spoof speech detection still have problems such as low spoof detection accuracy and poor generality.Therefore

an end-to-end spoof detection method based on context information and attention feature was proposed.Based on deep residual shrinkage network (DRSN)

the proposed method used the dual-branch context information coordination fusion module (DCCM) to aggregate rich context information

and fused features based on coordinate time-frequency attention (CTFA) to obtain cross-dimensional interaction features with context information

thus maximizing the potential of capturing artifacts.Compared with the best baseline system

in the ASVspoof 2019 LA dataset

the proposed method had reduced the EER and t-DCF performance indicators by 68% and 65% respectively

in the ASVspoof 2021 LA dataset

the EER and t-DCF of the proposed method were 4.81 and 0.311 5 and dropped by 48% and 10% separately.The experimental results show that this method can effectively improve the accuracy and generalization ability of spoof speech detection.

关键词

Keywords

references

KINNUNEN T , LI H . An overview of text-independent speaker recognition:from features to supervectors [J ] . Speech communication , 2010 , 52 ( 1 ): 12 - 40 .

SINGH N , AGRAWAL A , KHAN R A . Voice biometric:a technology for voice based authentication [J ] . Advanced Science,Engineering and Medicine , 2018 , 10 ( 7-8 ): 754 - 759 .

MITTAL A , DUA M . Automatic speaker verification systems and spoof detection techniques:review and analysis [J ] . International Journal of Speech Technology , 2021 ( 25 ): 1 - 30 .

徐剑 , 简志华 , 于佳祺 , 等 . 采用完整局部二进制模式的伪装语音检测 [J ] . 电信科学 , 2021 , 37 ( 5 ): 91 - 99 .

XU J , JIAN Z H , YU J Q , et al . Completed local binary pattern based speech anti-spoofing [J ] . Telecommunications Science , 2021 , 37 ( 5 ): 91 - 99 .

于佳祺 , 简志华 , 徐嘉 , 等 . 基于联合特征与随机森林的伪装语音检测 [J ] . 电信科学 , 2022 , 38 ( 6 ): 91 - 99 .

YU J Q , JIAN Z H , XU J , et al . Spoofing speech detection algorithm based on joint feature and random forest [J ] . Telecommunications Science , 2022 , 38 ( 6 ): 91 - 99 .

TAK H , PATINO J , TODISCO M , et al . End-to-end anti-spoofing with RawNet2 [C ] // Proceedings of 2021 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2021 : 6369 - 6373 .

GE W Y , PATINO J , TODISCO M , et al . Raw differentiable architecture search for speech deep fake and spoofing detection [EB ] . 2021 .

KANG W H , ALAM J , FATHAN A , et al . Attentive activation function for improving end-to-end spoofing countermeasure systems [EB ] . 2022 .

CHEN D S , LI J , XU K , et al . AReLU:attention-based rectified linear unit [EB ] . 2020 .

WANG X , YAMAGISHI J , TODISCO M , et al . ASVspoof 2019:a large-scale public data base of synthesized,converted and replayed speech [J ] . Computer Speech ＆ Language , 2020 , 64 : 101 - 114 .

YAMAGISHI J , WANG X , TODISCO M , et al . ASVspoof 2021:accelerating progress in spoofed and deep fake speech detection [EB ] . 2021 .

LING H F , HUANG L C , HUANG J R , et al . Attention-based convolutional neural network for ASV spoofing detection [C ] // Proceedings of 2021 INTERSPEECH .[S.l.:s.n. ] , 2021 : 4289 - 4293 .

ZHOU Y , ZHANG J W , ZHANG P G . Spoof speech detection based on raw cross-dimension interaction attention network [C ] // Proceedings of 2022 Chinese Conference on Biometric Recognition . Cham:Springer , 2022 : 621 - 629 .

HE K M , ZHANG X Y , REN S Q , et al . Deep residual learning for image recognition [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2016 : 770 - 778 .

HUA G , TEOH A B J , ZHANG H . Towards end-to-end synthetic speech detection [J ] . IEEE Signal Processing Letters , 2021 , 28 : 1265 - 1269 .

SZEGEDY C , LIU W , JIA Y , et al . Going deeper with convolutions [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2015 : 1 - 9 .

ZHAO M H , ZHONG S S , FU X Y , et al . Deep residual shrinkage networks for fault diagnosis [J ] . IEEE Transactions on Industrial Informatics , 2019 , 16 ( 7 ): 4681 - 4690 .

周晔 , 章坚武 , 程继承 . 面向复杂声学环境的伪装语音检测 [J ] . 传感技术学报 , 2022 , 35 ( 10 ): 1355 - 1362 .

ZHOU Y , ZHANG J W , CHENG J C . Speech anti-spoofing for complex acoustic environments [J ] . Chinese Journal of Sensors and Actuators , 2022 , 35 ( 10 ): 1355 - 1362 .

王金华 , 应娜 , 朱辰都 , 等 . 基于语谱图提取深度空间注意特征的语音情感识别算法 [J ] . 电信科学 , 2019 , 35 ( 7 ): 100 - 108 .

WANG J H , YING N , ZHU C D , et al . Speech emotion recognition algorithm based on spectrogram feature extraction of deep space attention feature [J ] . Telecommunications Science , 2019 , 35 ( 7 ): 100 - 108 .

LEI S , ZHOU Y X , CHEN L Y , et al . Towards expressive speaking style modelling with hierarchical context information for mandarin speech synthesis [C ] // Proceedings of the 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2022 : 7922 - 7926 .

HU J , SHEN L , ALBANIE S . Squeeze-and-excitation networks [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 7132 - 7141 .

WOO S , PARK J , LEE J Y , et al . CBAM:convolutional block attention module [C ] // Proceedings of the 2018 European Conference on Computer Vision .[S.l.:s.n. ] , 2018 : 3 - 19 .

HOU Q B , ZHOU D Q , FENG J S . Coordinate attention for efficient mobile network design [C ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recongnition . Piscataway:IEEE Press , 2021 : 13713 - 13722 .

DAI Y M , GIESEKE F , OEHMCKE S , et al . Attentional feature fusion [C ] // Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision . Piscataway:IEEE Press , 2021 : 3560 - 3569 .

LUO A W , LI E L , LIU Y L , et al . A capsule network based approach for detection of audio spoofing attacks [C ] // Proceed ings of 2021 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2021 : 6359 - 6363 .

LI X , WU X X , LU H , et al . Channel-wise gated Res2Net:towards robust detection of synthetic speech attacks [C ] // Proceedings of 2021 INTERSPEECH .[S.l.:s.n. ] , 2021 : 4314 - 4318 .

ZHANG Y , JIANG F , DUAN Z Y . One-class learning towards synthetic voice spoofing detection [J ] . IEEE Signal Processing Letters , 2021 , 28 : 937 - 941 .

COHEN A , RIMON I , AFLALO E , et al . A study on data augmentation in voice anti-spoofing [J ] . Speech Communication , 2022 , 141 : 56 - 67 .

DAS R K , . Known-unknown data augmentation strategies for detection of logical access,physical access and speech deep fake attacks:ASV spoof 2021 [C ] // Proceedings of 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge .[S.l.:s.n. ] , 2021 : 29 - 36 .

TAK H , KAMBLE M , PATINO J , et al . Raw boost:a raw data boosting and augmentation method applied to automatic speaker verification anti-spoofing [C ] // Proceedings of 2022 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP) . Piscataway:IEEE Press , 2022 : 6382 - 6386 .

CÁCERES J , FONT R , GRAU T . The biometric vox system for the ASVspoof 2021 challenge [C ] // Proceedings 2021 Edition of the Automatic Speaker Verification and Spoofing Countermeasures Challenge .[S.l.:s.n. ] , 2021 : 68 - 74 .

PAL M , RAIKAR A , PANDA A , et al . Synthetic speech detection using meta-learning with prototypical loss [EB ] . 2022 .

Views

335

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research and application of 5G cloud-network-edge-end integrated in-depth security protection system

Technical solution and application of 5G slicing private network based on cloud-network integration

Networking technology and implementation method based on 5G slice private line

End-to-end deterministic networking architecture and key technologies

End-to-end audiovisual speech recognition based on attention fusion of SDBN and BLSTM

Related Author

Guoxin ZHANG

Kai CHEN

Yan ZHANG

Xiaodong DUAN

Lu LU

Yongjing LI

Zongpeng DU

Peng LIU

Related Institution

Chengdu Branch of China Mobile Group Sichuan Co., Ltd.

Business School of Sichuan University

Patent Examination Cooperation Centre of the Patent Office, SIPO

China Mobile Group Gansu Co., Ltd.

Gansu Branch of China Telecom Co.,Ltd.

⁰