HDFS+MapReduce+Hive+HBase 十分钟快速入门
目录
1.前言 ............................................................................................................................................... 1
2.Hadoop 家族 .................................................................................................................................. 2
3.演练环境........................................................................................................................................ 2
3.1. 操作系统........................................................................................................................... 3
3.2. Hadoop ............................................................................................................................... 3
3.3. Hive .................................................................................................................................... 3
3.4. Java ..................................................................................................................................... 3
3.5. 机器 .................................................................................................................................. 3
3.6. 安装列表........................................................................................................................... 4
3.7. 安装路线........................................................................................................................... 4
4.配置 ssh2 和修改/etc/hosts .......................................................................................................... 4
4.1. 配置 ssh2 .......................................................................................................................... 5
4.2.修改/etc/hosts .................................................................................................................... 5
5.安装 Java ........................................................................................................................................ 5
6.安装 Hadoop .................................................................................................................................. 6
7.配置 HDFS ...................................................................................................................................... 6
7.1. 修改 hadoop-env.sh .......................................................................................................... 6
7.2. 修改 core-site.xml ............................................................................................................. 7
7.2.1.hadoop.tmp.dir ........................................................................................................ 7
7.2.2.fs.default.name ........................................................................................................ 7
7.3.修改 masters ............................................................................................................... 8
7.4.修改 slaves .................................................................................................................. 8
7.5.修改 hdfs-site.xml ....................................................................................................... 9
8.配置 MapReduce ........................................................................................................................... 9
8.1.修改 mapred-default.xml............................................................................................ 9
9.安装 Hive ..................................................................................................................................... 10
9.1. 安装 ant .................................................................................................................. 10
9.2. 安装 ivy ................................................................................................................... 10
9.3. 编译 Hive ................................................................................................................ 11
10.安装 HBase ................................................................................................................................ 11
11.体验 ........................................................................................................................................... 12
1.前言
本文的目的是让一个从未接触 Hadoop 的人,在很短的时间内快速上手,掌握编译、安装和