大数据技术综述

大数据技术综述Abstract: We are entering into a “big data” era. Due to the bottlenecks, such as poor scalability, installation and maintenance difficulties, fault tolerance and low performance, in traditional information technique framework, we need to leverage the cloud computing techniques and solutions to deal with big data problems. Cloud computing and big data are complementary to each other and have inherent connection of dialectical unity. The breakthrough of big data techniques will not only resolve the current situation, but also promote the wide application of cloud computing and the internet of things techniques. We focus on discussing the development and the pivotal techniques of big data. And provide a comprehensive description of big data from several perspectives, including the development of big data, the current data-burst situation, the relationship between big data and cloud computing and the big data techniques. Finally, we introduce the related technique researches and our current work.Key words:big data technique; cloud computing; data acquisition; data storage; data computation; presentation and interaction摘 要: 我们正在进入一个“大数据”时代 , 传统的信息技术架构, 存在着扩展性差、容错性差、性能低、安装部署及维护困难等诸多瓶颈, 需要以现代云计算手段和技术来解决大数据问题. 云计算与大数据是相辅相成、辨证统一的关系, 大数据技术的突破不仅能解决现实困难, 同时也会促使云计算、物联网技术真正落地并深化推广和应用. 针对大数据的进展历程以及关键性的大数据技术进行探讨, 从大数据的进展历程、当前面临的大数据问题、大数据与云计算的关系以及大数据技术等方面进行综合描述. 归纳总结相关的技术讨论和我们的讨论成果.关键词:大数据技术; 云计算; 数据采集; 数据存储; 数据计算; 展现与交互中图法分类号: TP301 文献标识码: A1 大 数 据 的 进 展 背 景 及 定 义当今, 信息技术为人类步入智能...