Hadoop技术体系介绍

Hadoop 体系介绍 [在此处键入] 目录 一、背景 .................................................................................................4 二、什么是 Hadoop ....................................................................................4 2.1、apache hadoop 项目 .....................................................................4 2.2、hadoop 的优点 .............................................................................5 2.3、Hadoop 的使用场景 .......................................................................6 三、Hadoop 发展状况及国内外应用情况 ...........................................................6 四、Hadoop 文件系统 HDFS .........................................................................7 4.1、HDFS 设计目标 ............................................................................7 4.2、HDFS 体系结构 ............................................................................8 4.3、HDFS 命名空间 ............................................................................9 4.4、HDFS 存储原理 ............................................................................9 4.5、数据存取策略 ............................................................................. 10 4.6、通讯协议 ................................................................................... 12 4.7、数据错误和异常 ........................................................................... 12 4.7、HDFS 尚未实现的功能总结 ............................................................. 13 五、MapReduce、hive 和 pig ..................................................................... 14 5.1、MapReduce .............................................................................. 14 5.2、Hive ........................................................................................ 15 5.3、Pig .......................................................................................... 16 5.4、Mapreduce、h...