Implementation strategy of telecom operators’ data lake technology

Junjun HU; Xiaojun XIE; Yanbin SHI; Qi YU

doi:10.11959/j.issn.1000-0801.2019029

您当前的位置：

首页 >

文章列表页 >

Implementation strategy of telecom operators’ data lake technology

Operational Technology Wide Angle | 更新时间：2024-06-05

- Implementation strategy of telecom operators’ data lake technology
- Telecommunications Science Vol. 35, Issue 2, Pages: 84-94(2019)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2019029
  CLC： TP399
- Published Online：2019-02，
  
  Published：20 February 2019
- 稿件说明：
移动端阅览
Junjun HU, Xiaojun XIE, Yanbin SHI, et al. Implementation strategy of telecom operators’ data lake technology[J]. Telecommunications science, 2019, 35(2): 84-94.
DOI：

Junjun HU, Xiaojun XIE, Yanbin SHI, et al. Implementation strategy of telecom operators’ data lake technology[J]. Telecommunications science, 2019, 35(2): 84-94. DOI： 10.11959/j.issn.1000-0801.2019029.

摘要

首先，从分析电信运营商传统数据架构入手，识别当前面临的数据质量不高、实时性不够、灵活性不足及存储和应用相互制约等问题。然后，讨论引入数据湖技术的可行性，明确数据湖的存储规模化和低成本、数据“原汁原味”和方便易用、应用按需建模等特点，能够为电信运营商数据架构优化提供非常有益的参考。最后，提出数据统一存储、统一标准、近源采集、与应用分离的电信运营商数据湖建设方案，并针对数据湖数据分区、部署、入湖及应用数据动态加载、数据统一管理等关键要点给予明确的阐述。

Abstract

Firstly

the traditional data architecture of telecom operators was analyzed and the problems such as low quality

lack of real-time

lack of flexibility and mutual constraints of storage and application were identified.Then

the feasibility of introducing data lake technology was discussed

the storage scale and low cost of data lake

the originality of data and ease of use

and the application of on-demand modeling were clarified

which could provide great benefits for telecom operators’ data architecture optimization.Finally

the data lake construction plan of unified storage

unified standards

near-source acquisition

and application separation was proposed

and key points such as data lake data partitioning

deployment

lake entry and application data dynamic loading

and unified data management were clearly stated.

关键词

Keywords

references

AliResearch . Activating productivity:model upgrading and paradigm transfer in DT era [R ] . 2015 .

TMF . TM_Forum_open_digital_architecture_whitepaper_V2 [R ] . 2018 .

TMF . TMF630_REST_API_design_guidelines_3.0_R17.5.1 [R ] . 2018 .

DIXON J . Pentaho,Hadoop and data lakes [Z ] . 2015 .

Wikipedia . Data lake [Z ] . 2017 .

PASQUA J . Schema-on-read vs schema-on-write [Z ] . 2019 .

TMF . GB922 information framework models R18.0.0 [S ] . 2018 .

China Telecom . EDM 4.0 [S ] . 2011 .

PWC . The enterprise data lake:better integration and deeper analytics [S ] . 2014 .

WILDER-JAMES E . The data lake dream [J ] . 2014 .

HALEVY A , KORN F , NATALYA F . Managing Google’s data lake:an overview of the goods system [Z ] . 2016 .

HALEVY A , KORN F , NOY N F , et al . Goods:organizing Google’s datasets [J ] . 2016 .

AWS . Populating the AWS glue data catalog [Z ] . 2018 .

郭云峰 , 蔡珩 , 戈磊 . 基于大数据网格的电信IT系统智能运维体系 [J ] . 电信科学 , 2018 , 34 ( 6 ): 153 - 161 .

GUO Y F , CAI H , GE L . Telecom intelligent operation system based on big data grid [J ] . Telecommunications Science , 2018 , 34 ( 6 ): 153 - 161 .

Views

1144

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Technology research and construction scheme of unified data lake

Related Author

Zhiyong LIU

Zhongjiang HE

Jinglong LIU

Yilong RUAN

Zhaofang MENG

Related Institution

No data

⁰