浏览全部资源
扫码关注微信
[ "汪保友(1968–),男,博士,中国联合网络通信有限公司上海市分公司高级工程师,主要研究方向为数据科学、数据挖掘、数据签名。" ]
[ "姚健(1981–),男,中国联合网络通信有限公司上海市分公司工程师、大数据中心总经理,主要研究方向为数据科学、移动互联网、通信网络规划。" ]
[ "张正卿(1978–),男,中国联合网络通信有限公司上海市分公司工程师,主要研究方向为数据科学、移动互联网、通信网络规划。" ]
网络出版日期:2018-03,
纸质出版日期:2018-03-20
移动端阅览
汪保友, 姚健, 张正卿. 基于FKS的信令采集与监控技术[J]. 电信科学, 2018,34(3):145-155.
Baoyou WANG, Jian YAO, Zhengqing ZHANG. Signaling collection and monitoring technology based on FKS[J]. Telecommunications science, 2018, 34(3): 145-155.
汪保友, 姚健, 张正卿. 基于FKS的信令采集与监控技术[J]. 电信科学, 2018,34(3):145-155. DOI: 10.11959/j.issn.1000-0801.2018096.
Baoyou WANG, Jian YAO, Zhengqing ZHANG. Signaling collection and monitoring technology based on FKS[J]. Telecommunications science, 2018, 34(3): 145-155. DOI: 10.11959/j.issn.1000-0801.2018096.
运营商信令数据具有丰富的应用价值,但其价值时效性强,随着时间的流逝而快速衰减。为了更好地服务于实时营销场景,必须有效提升信令数据的实时处理及分析能力。首先介绍某运营商基于FKS的信令采集处理方案,该方案综合发挥了Flume、Kafka、Spark Streaming三组件的各自优势,对运营商打造实时决策中心,起着重要支撑作用。此外,提出针对 Kafka 中消费者组对各主题(topic)消费情况的监控方案,该方案对实时流采集故障及时预警提供了有效的手段,在某运营商大数据平台运营实践过程中,有效减少信令消息队列拥堵现象,规避信令数据丢失风险,对实际生产运营支撑起着良好的保障作用。
The signaling data of telecom operators
which have a wide range of applications and great of values
is big data in real sense.In order to serve the real-time marketing scenarios better
the real-time processing and analysis ability of signaling data must be improved effectively.Firstly
the scheme of signaling collection and processing based on FKS was introduced
which combined the advantages of components such as Flume
Kafka and Spark Streaming
and played an important supporting role for operators to build real-time decision center.Furthermore
the Kafka monitoring program for topic consumption of consumer groups was proposed
which provided effective means for warning faults of real-time flow collection.The monitoring solution could effectively reduce the message queue congestion
avoid the risk of data loss
and also could obtain good application effects in practice.
许佳捷 , 郑凯 , 池明旻 , 等 . 轨迹大数据:数据、应用与技术现状 [J ] . 通信学报 , 2015 , 36 ( 12 ): 97 - 105 .
XU J J , ZHENG K , CHI M M , et al . Trajectory big data:data,applications and techniques [J ] . Journal on Communications , 2015 , 36 ( 12 ): 97 - 105 .
陆钢 , 王哲 , 区洪辉 , 等 . 基于开源软件的电信业务平台重构设计和分析 [J ] . 电信科学 , 2017 , 33 ( 5 ): 99 - 105 .
LU G , WANG Z , OU H H , et al . Design and analysis of telecom service platform reconstruction based on open source software [J ] . Telecommunications Science , 2017 , 33 ( 5 ): 99 - 105 .
刘炳涛 , 王达 , 叶笑春 , 等 . 基于数据流块的空间指令调度方法 [J ] . 计算机研究与发展 , 2017 , 54 ( 4 ): 750 - 763 .
LIU B T , WANG D , YE X C , et al . The data-flow block based spatial instruction scheduling method [J ] . Journal of Computer Research and Development , 2017 , 54 ( 4 ): 750 - 763 .
蒋仲安 , 王明 , 陈雅 . 基于地理坐标和轨迹数据的路径推荐方法 [J ] . 通信学报 , 2017 , 38 ( 5 ): 165 - 171 .
JIANG Z A , WANG M , CHEN Y . Path recommendation based on geographic coordinates and trajectory data [J ] . Journal on Communications , 2017 , 38 ( 5 ): 165 - 171 .
汤雅妃 , 魏进武 , 张云勇 . 基于大数据的信令监测系统研究 [J ] . 邮电设计技术 , 2014 ( 7 ): 47 - 52 .
TANG Y F , WEI J W , ZHANG Y Y . Research on big data based signaling monitoring platform [J ] . Designing Techniques of Posts and Telecommunications , 2014 ( 7 ): 47 - 52 .
孟红涛 , 余松平 , 刘芳 , 等 . Spark 内存管理及缓存策略研究 [J ] . 计算机科学 , 2017 , 44 ( 6 ): 31 - 35 .
MENG H T , YU S P , LIU F , et al . Research on memory management and cache replacement policies in spark [J ] . Computer Science , 2017 , 44 ( 6 ): 31 - 35 .
0
浏览量
482
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构