Study on Data Modeling and Collection in OSS Based on Hadoop

Lei Lei; Jingwen Li; Dapeng Gong; Rui Wang; Lei Su; Ningjiang Chen

doi:10.11959/j.issn.1000-0801.2015021

您当前的位置：

首页 >

文章列表页 >

Study on Data Modeling and Collection in OSS Based on Hadoop

Wide operating technology | 更新时间：2024-06-05

- Study on Data Modeling and Collection in OSS Based on Hadoop
- Telecommunications Science Vol. 31, Issue 1, Pages: 128-138(2015)
- 作者机构：
  
  1. 中国移动通信集团广西有限公司南宁 530022
  2. 亿阳信通股份有限公司南宁 530022
  3. 广西大学计算机与电子信息学院南宁 530004
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2015021
  CLC：
- Published Online：2015-01，
  
  Published：20 January 2015
- 稿件说明：
移动端阅览
Lei Lei, Jingwen Li, Dapeng Gong, et al. Study on Data Modeling and Collection in OSS Based on Hadoop[J]. Telecommunications science, 2015, 31(1): 128-138.
DOI：

Lei Lei, Jingwen Li, Dapeng Gong, et al. Study on Data Modeling and Collection in OSS Based on Hadoop[J]. Telecommunications science, 2015, 31(1): 128-138. DOI： 10.11959/j.issn.1000-0801.2015021.

摘要

针对电信运营商在构建大数据中心中所面临的数据采集、建模问题，分析了OSS 域的数据现状和特点，给出了一种基于层次分类梳理的建模方法论和数据模型管理思路，可实现对OSS域数据的统一采集、集中建模和数据共享，通过移动互联网端到端分析专题的应用案例进行验证，可对电信行业建设大数据中心提供借鉴。

Abstract

According to the data acquisition and the modeling problem of telecom operators facing in the construction of EDC

the data status and data characteristics in the OSS was analyzed

a modeling method of hierarchical classification of combing theory and data model management idea were proposed

the unification of OSS data collection

sharing the modeling and data concentration were realized. Through the application of end to end analysis on mobile internet terminal as case subject

it provides reference for the construction on telecom industry EDC.

关键词

Keywords

references

Barroso L A , Dean J , Holzle U , et al . Websearch for a planet: The Google cluster architecture . IEEE Micro , 2003 , 23 （ 2 ） 22 ～ 28

Xu Y , Kostamaa P , Qi Y . A Hadoop based distributed loading approach to parallel data warehouses . Proceedings of SIGMOD 2011 , Athens, Greece , 2011

詹志强，孟洛明，邱雪松 . 多专业网综合网管系统体系结构的研究 . 北京邮电大学学报， 2003 ( 1 )

Zhan Z Q , Meng L M , Qiu X S . Architecture of network management system for multi-technology network . Journal of Beijing University of Posts and Telecommunications , 2003 ( 1 )

Liu X F , Thomsen C , Pedersen T B . Cloud ETL: Scalable Dimensional ETL for Hadoop and Hive . DB Technical Report , 2012

Mohammed M , Mohd S A . A Framework for Interoperable Distributed ETL Components Based on SOA . Proceedings of ICSTE 2010 , San Juan, PR, USA , 2010

陈桂汉 . 综合电信管理解决方案 . 北京 : 电子工业出版社， 2002

Chen G H . Integrated Telecommunications Management Solutions . Beijing : Publishing House of Electronics Industry , 2002

Ghemawat S , Gobioff H , Le-ung S T . The Google file system . Proceedings of 19th Symposium on Operating Systems Principles , Lake George, New York, USA , 2003

Corbett J C , Dean J , Epstein M . Google's globally distributed database . Proceedings of the 10th USENIX Symposium on Operating Systems Design and Implementation, OSDI 2012 , Hollywood, CA, USA , 2012

Samuel P , Mal R , Kanth P . Automatic test case generation from UML communication diagrams . Information and Software Technology , 2007 ( 49 ): 158 ～ 171

Ling F , Chang E , Dillon T . A semantic network-based design methodology for XML documents . ACM Transactions on Information System（TOIS） , 2002 , 20 ( 4 ): 1 ～ 6

Dean J , Ghemawat S . MapReduce: Simplified data processing on large clusters . Proceedings of6th Symposium on Operating Systems Design and Implementation, OSDI'04 , San Francisco, USA , 2004

Views

1001

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research and implementation on acquisition scheme of telecom big data based on Hadoop

Mobile user behavior analysis system and applications based on big data

Orchestration system architecture design and implementation of smart line service

Research on the selection of grid data storage technology

A distributed high efficiency similarity matrix computation method based on users’ mobile network access location

Related Author

Shijin YUAN

Jing QIAN

Baoyou WANG

Hongxun GU

Ke YANG

Huan LI

Huiguang CHEN

Yiqi HONG

Related Institution

Shanghai Branch of China United Network Communication Co.,Ltd.

School of Software Engineering,Tongji University

Shanghai Zhongxing Power Construction Development Co.,Ltd.

Pudong Power Supply Company Under Shanghai Municipal Electric Power Corporation

Wuhan Institute of Technician

⁰