Data processing method for telecom data based on projection pursuit

Jinming ZHAO

doi:10.11959/j.issn.1000-0801.2016322.

您当前的位置：

首页 >

文章列表页 >

Data processing method for telecom data based on projection pursuit

Operating technology wide-angle | 更新时间：2024-06-05

- Data processing method for telecom data based on projection pursuit
- Telecommunications Science Vol. 32, Issue 12, Pages: 144-148(2016)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2016322.
  CLC： TN915
- Published Online：2016-12，
  
  Published：20 December 2016
- 稿件说明：
移动端阅览
Jinming ZHAO. Data processing method for telecom data based on projection pursuit[J]. Telecommunications science, 2016, 32(12): 144-148.
DOI：

Jinming ZHAO. Data processing method for telecom data based on projection pursuit[J]. Telecommunications science, 2016, 32(12): 144-148. DOI： 10.11959/j.issn.1000-0801.2016322..

摘要

在大数据时代，运营商采集和处理的数据出现了爆炸式增长。与此同时，采集数据维度增长使得从数据中提取信息的难度大大提高，导致了运营商新增的计算能力并没有带来与之匹配的信息处理能力提升。造成这一现象的主要原因在于并非所有维度上都有运营商关心的信息，过高的维度反而带来额外的噪音。因此，根据数据特性选择适当的维度十分必要。基于上述考虑，提出了一种基于投影寻踪的数据处理方法，并通过基于实际网络数据的对比验证了本文所述方案的有效性。

Abstract

In the big data era

the data which operator can collect and process is quickly growing. At the same time

due to the high dimension of the data

it is very difficult to extract and process information from them. This makes the waste of the computing capability of operators

even may lead to the decrease of performance due to the growth of the data dimension. The main reason of this phenomenon is that not all dimensions are interested with the information. Therefore

it is necessary to select the appropriate dimensions according to the data characteristics. Based on this

a data processing method based on projection pursuit was proposed. The result demonstrates the effectiveness of the scheme.

关键词

Keywords

references

BELLMAN T E . Adaptive control processes [M ] . Princeton : Princeton University Press ， 1961 .

MAATEN L J P V D , POSTMA E O , HERIK H J V D . Dimensionality reduction: a comparative review [J ] . Journal of Machine Learning Research , 2007 , 10 ( 1 ).

CARREIRA-PERPINAN M A . Continuous latentvariablemodels for dimensionalityreduction and sequentialdatareconstruction [EB/OL ] . ( 2001 - 01 - 29 )[ 2016 - 11 - 02 ] . http://xueshu.baidu.com/s?wd=Continuous+Latent+Variable+Models+for+Dimensionality+Reduction+and+Sequential+Data+Reconstruction＆tn=SE_baiduxueshu_c1gjeupa＆cl=3＆ie=utf-8＆bs=Dimensionality+reduction%3A+a+comparative+review＆f=8＆rsv_bp=1＆rsv_sug2=1＆sc_f_para=sc_tasktype%3D%7BfirstSimpleSearch%7D＆rsv_n=2 http://xueshu.baidu.com/s?wd=Continuous+Latent+Variable+Models+for+Dimensionality+Reduction+and+Sequential+Data+Reconstruction＆tn=SE_baiduxueshu_c1gjeupa＆cl=3＆ie=utf-8＆bs=Dimensionality+reduction%3A+a+comparative+review＆f=8＆rsv_bp=1＆rsv_sug2=1＆sc_f_para=sc_tasktype%3D%7BfirstSimpleSearch%7D＆rsv_n=2 .

DONOHO D L . High dimensional data analysis: the curses and blessings of dimensionality [EB/OL ] . ( 2000 - 01 - 29 )[ 2016 - 11 - 02 ] . http://xueshu.baidu.com/s?wd=High+dimensional+data+analysis%3A+the+curses+and+blessings+of+dimensionality＆tn=SE_baiduxueshu_c1gjeupa＆cl=3＆ie=utf-8＆bs=Continuous+Latent+Variable+Models+for+Dimensionality+Reduction+and+Sequential+Data+Reconstruction＆f=8＆rsv_bp=1＆rsv_sug2=1＆sc_f_para=sc_tasktype%3D%7BfirstSimpleSearch%7D＆rsv_n=2 http://xueshu.baidu.com/s?wd=High+dimensional+data+analysis%3A+the+curses+and+blessings+of+dimensionality＆tn=SE_baiduxueshu_c1gjeupa＆cl=3＆ie=utf-8＆bs=Continuous+Latent+Variable+Models+for+Dimensionality+Reduction+and+Sequential+Data+Reconstruction＆f=8＆rsv_bp=1＆rsv_sug2=1＆sc_f_para=sc_tasktype%3D%7BfirstSimpleSearch%7D＆rsv_n=2 .

DIACONIS P , FEREDMNA D . Asymptotics of graphical projection pursuit [J ] . Annals of Statistics , 1984 , 12 ( 3 ): 793 - 815 .

张维明 . 数据仓库原理与应用 [M ] . 北京 : 电子工业出版社， 2002 .

ZHANG W M . The principle and application of data warehouse [M ] . Beijing : Publishing House of Electronics Industry , 2002 .

Views

363

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Upgrade of the dedicated network for the Department of Ecology and Environment based on SDWAN bearer technology

Application and research of SDN-based management and control technology for optical transport grey-box devices

Accuracy analysis on access hyper-point real-time detection algorithms in high-speed network

A review of network traffic analysis targeting mobile devices

A network status evaluation method based on random projection

Related Author

XU Yiqiang

Xiaofeng WU

Fei YAN

Ruiquan JING

Junjie LI

Xiaoli HUO

Guoyong ZHAO

Qian HU

Related Institution

Jiangsu Provincial Ecological Environmental Monitoring Center

Research Institute of China Telecom Co., Ltd.

China Telecom Group Co., Ltd.

School of Cyberspace,Hangzhou Dianzi University

Department of Computer and Information Technology, Zhejiang Police College

⁰