Discussion on Integration of Data Warehouse and Big Data

Juan Yu

doi:10.11959/j.issn.1000-0801.2015066

您当前的位置：

首页 >

文章列表页 >

Discussion on Integration of Data Warehouse and Big Data

Electric power information column | 更新时间：2024-06-05

- Discussion on Integration of Data Warehouse and Big Data
- Telecommunications Science Vol. 31, Issue 3, Pages: 159-163(2015)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-0801.2015066
  CLC：
- Published Online：2015-03，
  
  Published：20 March 2015
- 稿件说明：
移动端阅览
Juan Yu. Discussion on Integration of Data Warehouse and Big Data[J]. Telecommunications science, 2015, 31(3): 159-163.
DOI：

Juan Yu. Discussion on Integration of Data Warehouse and Big Data[J]. Telecommunications science, 2015, 31(3): 159-163. DOI： 10.11959/j.issn.1000-0801.2015066.

摘要

针对传统企业对非结构化数据缺乏有效利用的问题，探讨了基于数据仓库与大数据融合的企业大数据解决方案。根据数据仓库建设理论和下一代企业级数据仓库架构，利用Hadoop技术进行非结构化数据的收集、处理及存储，通过与传统数据仓库和BI工具共同协作，解决企业大数据应用困难的问题。数据仓库与大数据技术的融合解决了传统企业数据处理的障碍，从而推动大数据项目的实施。

Abstract

In view of the traditional enterprise couldn't use such unstructured data efficiently

a big data solutions based on integration of data warehouse and big data was discussed.Based on the theory of data warehouse construction and architecture of the next-generation EDW

Hadoop was used to collection

processing and storage for unstructured data.By big data technology work together with traditional data warehouse and BI

to help enterprises to solve difficulties that applied.Integration of data warehouse and big data can resolve the difficulty on data processing and promote the implementation of big data projects.

关键词

Keywords

references

陈继东 . 数据库发展史 . 程序员， 2004 （ 6 ）: 46 ～ 50

Chen J D . History of the development of database . Programmer , 2004 （ 6 ）: 46 ～ 50

Gartner . Hype cycle for emerging technologies . http://www.gartner.com/newsroom/id/2575515 http://www.gartner.com/newsroom/id/2575515 , 2013

Gartner . Hype cycle for emerging technologies . http://www.gartner.com/newsroom/id/2819918 http://www.gartner.com/newsroom/id/2819918 , 2014

Kearney A T . Beyond big:the analytically powered organization . http://www.atkearney.com/analytics/featured-article/-/asset_publisher/FNSUwH9BGQyt/content/beyond-big-the-analytically-powered-organization/10192 http://www.atkearney.com/analytics/featured-article/-/asset_publisher/FNSUwH9BGQyt/content/beyond-big-the-analytically-powered-organization/10192 , 2014

王倩，朱宏峰，刘天华 . 大数据安全的现状与发展 . 计算机与网络， 2013 （ 16 ）: 66 ～ 69

Wang Q , Zhu H F , Liu T H . Current status and development of big data security . Comput ＆ Network , 2013 （ 16 ）: 66 ～ 69

Yuhanna N , Gualtieri M . The forrester wave:enterprise data warehouse . http://www.forrester.com/pimages/rws/reprints/document/86621/oid/1-M6RP7C http://www.forrester.com/pimages/rws/reprints/document/86621/oid/1-M6RP7C , 2013

辛晃，易兴辉，陈震宇 . 基于Hadoop+MPP架构的电信运营商网络数据共享平台研究 . 电信科学， 2014 , 30 （ 4 ）: 135 ～ 145

Xin H , Yi X H , Chen Z Y . Design of telecom operators' network data sharing platform Based on Hadoop +MPP architecture . Telecommunications Science , 2014 （ 4 ）: 135 ～ 145

John Kreisa . Hadoop and the Data Warehouse:When to Use Which . http://hortonworks.com/blog/hadoop-and-the-data-warehouse-when-to-use-which/ http://hortonworks.com/blog/hadoop-and-the-data-warehouse-when-to-use-which/ , 2013

沈雷明，别志铭 . 基于电信大数据的数据建模平台研究 . 电信科学， 2014 , 30 （ 6 ）: 138 ～ 141

Shen L M , Bie Z M . Research on data modeling platform based on big data of telecom . Telecommunications Science , 2014 , 30 （ 6 ）: 138 ～ 141

Views

1618

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Applications of a big data platform based on PaaS

Research and implementation on acquisition scheme of telecom big data based on Hadoop

Practice and thinking on the transition of telecom operator analysis support system in big data era

Hadoop bottleneck detection algorithm based on information gain

An associated perception import method for big data

Related Author

Haiyong XU

Yan HUANG

Baoyou WANG

Jing QIAN

Shijin YUAN

Nanhai LIU

Lei LEI

Rui WANG

Related Institution

School of Software Engineering,Tongji University

Shanghai Branch of China United Network Communication Co.,Ltd.

Guangzhou Useease Information Technology Co.,Ltd.

School of Computers,Guangdong University of Technology

Nanjing University of Posts and Telecommunications

⁰