基于混合高斯变分自编码网络的异常检测算法

陈华华; 陈哲; 郭春生; 应娜; 叶学义; 章坚武

doi:10.11959/j.issn.1000-0801.2021044

您当前的位置：

首页 >

文章列表页 >

基于混合高斯变分自编码网络的异常检测算法

研究与开发 | 更新时间：2024-06-05

- 基于混合高斯变分自编码网络的异常检测算法
- Anomaly detection algorithm based on Gaussian mixture variational auto encoder network
- 电信科学 2021年37卷第4期页码：54-61
- 作者机构：
- 作者简介：
  
  [ "陈华华（1975- ），男，博士，杭州电子科技大学副教授，主要研究方向为数字图像处理、计算机视觉和模式识别" ]
  [ "陈哲（1995- ），男，杭州电子科技大学硕士生，主要研究方向为异常检测" ]
  [ "郭春生（1971- ），男，杭州电子科技大学副教授，主要研究方向为视频分析与模式识别" ]
  [ "应娜（1978- ），女，杭州电子科技大学副教授，主要研究方向为信号处理、语音信号处理及其应用" ]
  [ "叶学义（1973- ），男，博士，杭州电子科技大学副教授，主要研究方向为图像处理、模式识别、信息隐藏" ]
  [ "章坚武（1961- ），男，博士，杭州电子科技大学教授，博士生导师，主要研究方向为移动通信、多媒体信号处理与人工智能、通信网络与信息安全" ]
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2021044
  中图分类号： TP393
- 网络出版日期：2021-04，
  
  纸质出版日期：2021-04-20
- 稿件说明：
移动端阅览
陈华华, 陈哲, 郭春生, 等. 基于混合高斯变分自编码网络的异常检测算法[J]. 电信科学, 2021,37(4):54-61.

Huahua CHEN, Zhe CHEN, Chunsheng GUO, et al. Anomaly detection algorithm based on Gaussian mixture variational auto encoder network[J]. Telecommunications science, 2021, 37(4): 54-61.
陈华华, 陈哲, 郭春生, 等. 基于混合高斯变分自编码网络的异常检测算法[J]. 电信科学, 2021,37(4):54-61. DOI： 10.11959/j.issn.1000-0801.2021044.

Huahua CHEN, Zhe CHEN, Chunsheng GUO, et al. Anomaly detection algorithm based on Gaussian mixture variational auto encoder network[J]. Telecommunications science, 2021, 37(4): 54-61. DOI： 10.11959/j.issn.1000-0801.2021044.

摘要

异常数据是指偏离大量正常数据点的数据，往往会对各类系统产生负面影响，存在较大风险。异常检测作为一种有效的防护手段，能够检测数据中的异常，为各类系统的正常运转提供重要支撑，具有重要的现实意义。提出了一种基于混合高斯变分自编码网络的异常检测算法，该算法首先使用混合高斯先验构建变分自编码器，对输入数据进行特征提取，然后以混合高斯变分自编码器构建深度支持向量网络，压缩特征空间，并寻找最小超球体分离正常数据和异常数据，通过计算数据特征到超球体中心的欧氏距离衡量数据的异常分数，并以此进行异常检测。最后在基准数据集MNIST和Fashion-MNIST上评估了该算法，平均AUC分别达到了0.954和0.937。实验结果表明，所提出的算法取得了较好的异常检测效果。

Abstract

Anomalous data

which deviates from a large number of normal data

has a negative impact and contains a risk on various systems.Anomaly detection can detect anomalies in the data and provide important support for the normal operation of various systems

which has important practical significance.An anomaly detection algorithm based on Gaussian mixture variational auto encoder network was proposed

in which a variational autoencoder was built to extract the features of the input data based on Gaussian mixture distribution

and using this variational autoencoder to construct a deep support vector network to compress the feature space and find the minimum hyper sphere to separate the normal data and the abnormal data.Anomalies can be detected by the score from the Euclidean distance from the feature of data to the center of the hypersphere.The proposed algorithm was evaluated on the benchmark datasets MNIST and Fashion-MNIST

and the corresponding average AUC are 0.954 and 0.937 respectively.The experimental results show that the proposed algorithm achieves preferable effects.

关键词

Keywords

references

HAWKINS D M . Identification of outliers [M ] . London : Chapman and Hall , 1980 .

AHMED M , MAHMOOD A N , ISLAM M R . A survey of anomaly detection techniques in financial domain [J ] . Future Generation Computer Systems , 2016 ( 55 ): 278 - 288 .

张冰涛 , 王小鹏 , 王履程 , 等 . 基于图论的 MANET 入侵检测方法 [J ] . 电子与信息学报 , 2018 , 40 ( 6 ): 1446 - 1452 .

ZHANG B T , WANG X P , WANG L C , et al . Intrusion detection method for MANET based on graph theory [J ] . Journal of Electronics ＆ Information Technology , 2018 , 40 ( 6 ): 1446 - 1452 .

潘雪峰 . 基于 CNN 的手骨异常检测研究与系统实现 [D ] . 长春:东北师范大学 , 2019 .

PAN X F . Research and system implementation of abonormal hand bone detection based on CNN [D ] . Changchun:the Dissertation of Northeast Normal University , 2019 .

陆峰峰 , 吴浩文 , 顾伟 . 基于PI和PSS系统的设备异常状态监控的设计与实现 [J ] . 工业设计 , 2017 ( 4 ): 167 - 168 .

LU F F , WU H W , GU W . Design and implementation of equipment abnormal condition monitoring based on PI and PSS system [J ] . Indurstrial Design , 2017 ( 4 ): 167 - 168 .

吴新宇 , 郭会文 , 李楠楠 , 等 . 基于视频的人群异常事件检测综述 [J ] . 电子测量与仪器学报 , 2014 , 28 ( 6 ): 575 - 584 .

WU X Y , GUO H W , LI N N , et al . Survey on the video-based abnormal event detection in crowd scenes [J ] . Journal of Electronic Measurement and Instrument , 2014 , 28 ( 6 ): 575 - 584 .

SANDER J . LOF:identifying density-based local outliers [J ] . ACM SIGMOD Record , 2000 , 29 ( 2 ): 93 - 104 .

LIU F T , TING K M , ZHOU Z H . Isolation forest [C ] // Proceedings of 2008 Eighth IEEE International Conference on Data Mining . Piscataway:IEEE Press , 2008 : 413 - 422 .

AN J , CHO S . Variational autoencoder based anomaly detection using reconstruction probability [J ] . Special Lecture on IE , 2015 ( 12 ): 1 - 18 .

杜辰飞 , 高峰 , 袁涛 , 等 . 面向飞参数据异常检测的 SAE优化方法比较 [J ] . 信息技术 , 2015 , 39 ( 12 ): 181 - 185 .

DU C F , GAO F , YUAN T , et al . A comparison for optimization methods of SAE in allusion to flight data abnormity detection [J ] . Information Technology , 2015 , 39 ( 12 ): 181 - 185 .

LI X , KIRINGA I , YEAP T , et al . Exploring deep anomaly detection methods based on capsule net [C ] // Proceedings of ICML 2019 Workshop on Uncertainty ＆ Robustness in Deep Learning .[S.l.:s.n. ] , 2019 .

丁建立 , 邹云开 , 王静 , 等 . 基于深度学习的 ADS-B 异常数据检测模型 [J ] . 航空学报 , 2019 , 40 ( 12 ): 167 - 177 .

DING J L , ZOU Y K , WANG J , et al . ADS-B anomaly data detection model based on deep learning [J ] . Acta Aeronautica et Astronautica Sinica , 2019 , 40 ( 12 ): 167 - 177 .

KINGMA D P , WELLING M . Auto-encoding variational bayes [Z ] . 2013 .

GUO C , ZHOU J . Variational autoencoder with optimizing Gaussian mixture model priors [J ] . IEEE Access , 2020 ( 99 ): 1 .

HERSHEY J R , OLSEN P A . Approximating the kullback Leibler divergence between Gaussian mixture models [C ] // Proceedings of IEEE International Conference on Acoustics,Speech and Signal Processing . Piscataway:IEEE Press , 2007 .

TAX D M J , DUIN R P W . Support vector data description [J ] . Machine Learning , 2004 , 54 ( 1 ): 45 - 66 .

SABOUR S , FROSST N , HINTON G E . Dynamic routing between capsules [C ] // Proceedings of Advances in Neural Information Processing Systems . New York:Curran Associates , 2017 : 3856 - 3866 .

TUCKER A L . A reexamination of finite-and infinite-variance distributions as models of daily stock returns [J ] . Journal of Business ＆ Economic Statistics , 1992 , 10 ( 1 ): 73 - 81 .

LECUN Y , BOTTOU L , BENGIO Y , et al . Gradient-based learning applied to document recognition [J ] . Proceedings of the IEEE , 1998 , 86 ( 11 ): 2278 - 2324 .

XIAO H , RASUL K , VOLLGRAF R . Fashion-MNIST:a novel image dataset for benchmarking machine learning algorithms [Z ] . 2017 .

MANEVITZ L M , YOUSEF M . One-class SVMs for document classification [J ] . Journal of Machine Learning Research , 2001 , 2 ( 12 ): 139 - 154 .

MAKHZANI A , FREY B J . Winner-take-all autoencoders [Z ] . 2015 .

SCHLEGL T , SEEBÖCK P , WALDSTEIN S M , et al . Unsupervised anomaly detection with generative adversarial networks to guide marker discovery [C ] // Proceedings of International Conference on Information Processing in Medical Imaging . Berlin:Springer , 2017 : 146 - 157 .

浏览量

429

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于钉板分布稀疏变分自编码器的异常检测算法研究

智能运维中KPI异常检测的研究进展

基于深度学习的软件定义网络应用策略冲突检测方法