Technology research and construction scheme of unified data lake

Zhiyong LIU; Zhongjiang HE; Jinglong LIU; Yilong RUAN; Zhaofang MENG

doi:10.11959/j.issn.1000-0801.2021019

您当前的位置：

首页 >

文章列表页 >

Technology research and construction scheme of unified data lake

Engineering and Application | 更新时间：2024-06-05

- Technology research and construction scheme of unified data lake
- Telecommunications Science Vol. 37, Issue 1, Pages: 121-128(2021)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2021019
  CLC： TP399
- Published Online：2021-01，
  
  Published：20 January 2021
- 稿件说明：
移动端阅览
Zhiyong LIU, Zhongjiang HE, Jinglong LIU, et al. Technology research and construction scheme of unified data lake[J]. Telecommunications science, 2021, 37(1): 121-128.
DOI：

Zhiyong LIU, Zhongjiang HE, Jinglong LIU, et al. Technology research and construction scheme of unified data lake[J]. Telecommunications science, 2021, 37(1): 121-128. DOI： 10.11959/j.issn.1000-0801.2021019.

摘要

从企业数字化转型要求和大数据平台面临的挑战分析入手，阐述了统一数据湖的建设思路和入湖原则，提出了采用逻辑统一、物理分散、统一数据目录、统一安全管理、应用解耦融合的BSS/MSS/OSS跨域融合的统一数据湖建设方案，并描述了统一数据湖建设实践经验。

Abstract

From the requirements of enterprise digital transformation and the challenges faced by big data platform

the construction ideas and principles of unified data lake were expounded.A unifid data lake construction scheme based on BSS/MSS/OSS cross domain fusion was proposed

which adopted logical unification

physical dispersion

unified data directory

unified security management and application of decoupling fusion.The construction practice of unified data lake was described in recent two years.

关键词

Keywords

references

DIXON J . Pentaho,Hadoop and data lakes [Z ] . 2015 .

Wikipedia Data lake [Z ] . 2017 .

胡军军 , 谢晓军 , 石彦彬 , 等 . 电信运营商数据湖技术实施策略 [J ] . 电信科学 , 2019 , 35 ( 2 ): 84 - 93 .

HU J J , XIE X J , SHI Y B , et al . Telecom operators’ data lake technology implementation strategy [J ] . Telecommunications Science , 2019 , 35 ( 2 ): 84 - 93 .

WILDER-JAMES . The data lake dream [Z ] . 2014 .

Views

751

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Implementation strategy of telecom operators’ data lake technology

Multi-user fine-grained task offloading scheduling strategy under cloud-edge-end collaboration

Edge computing smart grid resource scheduling algorithm based on reinforcement learning

Resource scheduling optimization in cloud-edge collaboration

A survey on 5G capabilities enabling the factories of the future

Related Author

Junjun HU

Xiaojun XIE

Yanbin SHI

Qi YU

XIE Mande

HUANG Zhufang

SUN Hao

Jinghang YU

Related Institution

School of Information and Electronic Engineering, Zhejiang Gongshang University

School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University

Key Laboratory of System Control and Information Processing, Ministry of Education of China

Shanghai Engineering Research Center of Intelligent Control and Management

Beijing Jingwei Information Technology Co.,Ltd.

⁰