Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing

Bin Dong; Di Yang; Zheng Wang; Wenhong Zhou

doi:10.11959/j.issn.1000-0801.2015212

您当前的位置：

首页 >

文章列表页 >

Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing

Operating technology wide-angle | 更新时间：2024-06-05

- Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing
- Telecommunications Science Vol. 31, Issue 10, Pages: 165-171(2015)
- 作者机构：
  
  1. 中国电信股份有限公司上海研究院上海 200122
  2. 中国电信集团公司北京 100032
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2015212
  CLC：
- Published Online：2015-10，
  
  Published：20 October 2015
- 稿件说明：
移动端阅览
Bin Dong, Di Yang, Zheng Wang, et al. Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing[J]. Telecommunications science, 2015, 31(10): 165-171.
DOI：

Bin Dong, Di Yang, Zheng Wang, et al. Steam Computing Analysis and Application on Operator Real-time Signal Big Data Processing[J]. Telecommunications science, 2015, 31(10): 165-171. DOI： 10.11959/j.issn.1000-0801.2015212.

摘要

基于Hadoop搭建的大数据平台采用离线批处理的方式，无法满足对数据实效性敏感的业务要求。针对运营商动态数据信息开放大数据平台的实时信令处理要求，对流式计算大数据组件进行了分析，介绍了与流计算大数据相关的实时采集、汇聚和处理组件，形成了端到端实时信令处理大数据技术解决方案，并提出了融合批处理和实时计算的大数据平台解决方案，提高了网络信令数据的时效性，为业务创新提供更大空间，带来更多利益。

Abstract

Big data platform based on the Hadoop structures using offline batch processing mode，unable to meet the service requirements for data timeliness.In order to solve the real-time signal processing requirements in operator OIDD（open information of dynamic data）big data platform，the big-data system components of stream computing were discussed，real-time data collecting，distribution and processing components which formed the end-to-end real-time signal processing big data technology solutions were recommended，and the solutions of the OIDD big data platform which integrated batch computing and stream computing were proposed.It will improve the timeliness of the network signaling data and provide more space for business innovation and bring more benefits.

关键词

Keywords

references

Condiet T ， Alvaro P ， Hellerstein J M ， et al . MapReduce Online . UCB/EECS-2009-136 ， 2009

Apache Software Foundation . Welcome to Apache Hadoop . http://hadoop.apache.org http://hadoop.apache.org ， 2015

孙大为，张广艳，郑纬民 . 大数据流式计算：关键技术及系统实例 . 软件学报， 2014 ， 25 （ 4 ）： 839 ～ 862

Sun D W ， Zhang G Y ， Zheng W M . Big data stream computing：technologies and instances . Journal of Software ， 2014 ， 25 （ 4 ）： 839 ～ 862

Neumeyer L ， Robbins B ， Nair A ， et al . S4：distributed stream computing platform . Proceedings of the IEEE International Conference on Data Mining Workshops ， Sydney，Australia ， 2010

崔星灿，禹晓辉，刘洋等 . 分布式流处理技术综述 . 计算机研究与发展， 2015 ， 52 （ 2 ）： 318 ～ 332

Cui X C ， Yu X H ， Liu Y ， et al . Distributed stream processing：a survey . Journal of Computer Research and Development ， 2015 ， 52 （ 2 ）： 318 ～ 332

Apache Software Foundation . Spark Streaming makes it easy to build scalable fault-tolerant streaming applications . http://spark.apache.org/streaming/ http://spark.apache.org/streaming/ ， 2015

Apache Software Foundation . Apache Kafka：a high-throughput distributed messaging system . http://kafka.apache.org/ http://kafka.apache.org/ ， 2015

Apache Software Foundation . Storm official website . http://storm.apache.org/ http://storm.apache.org/ ， 2015

Apache Software Foundation . Welcome to Apache ZooKeeper . http://zookeeper.apache.org/ http://zookeeper.apache.org/ ， 2015

Vavilapali V K ， Murthy A C ， Douglas C ， et al . Apache Hadoop YARN：yet another resource negotiator . Proceedings of the 4th ACM Symposium on Cloud Computing，Santa Clara ， California，USA ， 2013

Views

979

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Security access permission authentication simulation of multi-source network big data based on blockchain

Research on theoretical ultimate value of 5G flow residence ratio based on big data

A big data framework for short-term power load forecasting using heterogenous data

Architecture of a new infrastructure for data service in DT era

Big data security features and operation practices

Related Author

Bin LI

Hui HE

Zhongying ZHAO

Jingwei GUO

Hongjia LIU

Bei LI

Wei ZHAO

Guoping XU

Related Institution

Research Institute of China United Network Communications Co., Ltd.

China United Network Communications Group Co., Ltd.

Zhejiang Branch of China United Network Communications Co., Ltd.

Willfar Information Technology Co., Ltd.

China Electronic Power Equipment and Technology Co., Ltd.

⁰