Research on the selection of grid data storage technology

Chengling LI; Yuxiang ZHENG; Yiqi HONG; Wen LI; Huimin GUO

doi:10.11959/j.issn.1000-0801.2018134

您当前的位置：

首页 >

文章列表页 >

Research on the selection of grid data storage technology

Power information column | 更新时间：2024-06-05

- Research on the selection of grid data storage technology
- Telecommunications Science Vol. 34, Issue 5, Pages: 183-191(2018)
- 作者机构：
  
  1. 国网上海市电力公司浦东供电公司，上海 200122
  2. 上海中兴电力建设发展有限公司，上海 200122
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2018134
  CLC： TP392
- Published Online：2018-05，
  
  Published：20 May 2018
- 稿件说明：
移动端阅览
Chengling LI, Yuxiang ZHENG, Yiqi HONG, et al. Research on the selection of grid data storage technology[J]. Telecommunications science, 2018, 34(5): 183-191.
DOI：

Chengling LI, Yuxiang ZHENG, Yiqi HONG, et al. Research on the selection of grid data storage technology[J]. Telecommunications science, 2018, 34(5): 183-191. DOI： 10.11959/j.issn.1000-0801.2018134.

摘要

国网将采用国网公司大数据平台分布式文件系统（基于 HDFS 优化封装）存储非结构化数据与实时数据。大数据平台分布式文件系统基于 HDFS 优化封装，HDFS 具有高容错、低成本、高吞吐量等特性，适合大规模数据集的应用，能有效支持大文件存储。介绍了非结构化数据存储以及实时数据存储，对电网数据存储技术选型进行了研究。

Abstract

Unstructured data and real-time data were storaged by state grid company’s big data platform distributed file system (based on HDFS optimized package).Based on HDFS optimized packaging

HDFS was characterized by high fault tolerance

low cost and high throughput.It was suitable for large-scale data set applications and effectively supports large file storage.The unstructured data storage and real-time data storage was introduced

and the selection of grid data storage technology was studied.

关键词

Keywords

references

GEORGE L . HBase 权威指南 [M ] . 代志远 , 刘佳 , 蒋杰 ,译. 北京 : 人民邮电出版社 , 2013 .

GEORGE L . HBase:the definitive guide [M ] . Translated by DAI Z Y,LIU J,JIANG J . Beijing : Posts ＆ Telecom Press , 2013 .

蔡斌 , 陈湘萍 . Hadoop技术内幕:深入解析Hadoop Common和 HDFS 架构设计与实现原理 [M ] . 北京 : 机械工业出版社 , 2013 .

CAI B , CHEN X P . Hadoop internals:in-depths study of common and HDFS [M ] . Beijing : China Machine Press , 2013 .

孟鑫 , 马延辉 , 李立松 . HBase企业应用开发实战 [M ] . 北京 : 机械工业出版社 , 2014 .

MENG X , MA Y H , LI L S . Enterprise application development with HBase [M ] . Beijing : China Machine Press , 2014 .

皮雄军 . NoSQL 数据库技术实战 [M ] . 北京 : 清华大学出版社 , 2015 .

PI X J . NoSQL database technology combat [M ] . Beijing : Tsinghua University Press , 2015 .

DIMIDUK N , KHURANA A . HBase实战 [M ] . 谢磊,译.北京 : 人民邮电出版社 , 2013 .

DIMIDUK N , KHURANA A . HBase in action [M ] . Translated by XIE L . Beijing : Posts ＆ Telecom Press , 2013 .

蒋燚峰 . HBase管理指南 [M ] . 北京 : 人民邮电出版社 , 2013 .

JIANG Y F . HBase administration cookbook [M ] . Beijing : Posts＆ Telecom Press , 2013 .

SHRIPARV S . Learning HBase [M ] . 周彦伟 , 蒲聪 , 蒋杰 ,译. 北京 : 电子工业出版社 , 2015 .

SHRIPARV S . Learning HBase [M ] . Translated by ZHOU Y W,LOU S,PU C . Beijing : Publishing House of Electronics Industry , 2015 .

董西成 . Hadoop技术内幕:深入解析MapReduce架构设计与实现原理 [M ] . 北京 : 机械工业出版社 , 2013 .

DONG X C . Hadoop internals:in-depths study of MapReduce [M ] . Beijing : China Machine Press , 2013 .

GROVER M , MALASKA T , SEIDMAN J . Hadoop应用架构 [M ] . 郭文超 ,译. 北京 : 人民邮电出版社 , 2017 .

GROVER M , MALASKA T , SEIDMAN J . Hadoop application architecture [M ] . Translated by GUO W C . Beijing : Posts ＆Telecom Press , 2017 .

王雪迎 . Hadoop 构建数据仓库实践 [M ] . 北京 : 清华大学出版社 , 2017 .

WANG X Y . Practice of Hadoop data warehouse [M ] . Beijing : Tsinghua University Press , 2017 .

WHITE T . Hadoop权威指南:大数据的存储与分析(第4版) [M ] . 王海 , 华东 , 刘喻 ,等译. 北京 : 清华大学出版社 , 2017 .

WHITE T . Hadoop:the definitive guide [M ] . Translated by WANG H,HUA D,LIU Y,et al . Beijing : Tsinghua University Press , 2017 .

Views

522

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

AI-enabled 5G energy-saving technology

Analysis of value-added services of power communication network in energy internet

SDN solutions for cloud data center

Key point of NFV hardware resource pool planning and construction

A distributed high efficiency similarity matrix computation method based on users’ mobile network access location

Related Author

Dan XU

Yu ZENG

Weiye MENG

Lika LI

Hong ZHU

Qi SHAO

Cui ZHONG

Lei WANG

Related Institution

Wuhan Institute of Technician

Wuhan Ship Communication Research Institute

School of Electronics and Information,Wuhan University

Shanghai Yamu Communication Technology Co.,Ltd.

Guangzhou Research Institute of China Telecom Co., Ltd.

⁰