Hadoop集群部署完整版资源-CSDN文库

版权申诉

hadoop

data

123 浏览量 2022-05-05 09:46:20 上传评论收藏 1.33MB PDF 举报

资源推荐

资源详情

资源评论

Hadoop

安装部署

Richard Zhao

2012/4/19

一．

HADOOP

简介

........................................................................................................................... 3

1.1 HADOOP 主要的特点 ....................................................................................................................... 3

1.2HADOOP 的用途 ............................................................................................................................... 4

二．

HADOOP

架构

........................................................................................................................... 4

2.1 HDFS ............................................................................................................................................... 4

2.1.1 NameNode .............................................................................................................................. 4

2.1.2 DataNode ............................................................................................................................... 5

2.2 MAPREDUCE ..................................................................................................................................... 5

2.3 文件操作 ...................................................................................................................................... 7

2.4 LINUX 集群 ..................................................................................................................................... 8

三、

其它应用

................................................................................................................................ 8

四．

HADOOP

部署

........................................................................................................................... 9

4.1 测试机： ...................................................................................................................................... 9

4.2 准备工作： .................................................................................................................................. 9

4.3 SSH 设置 ...................................................................................................................................... 10

4.4 安装 JDK ...................................................................................................................................... 10

4.5 设置安装 HADOOP ....................................................................................................................... 11

4.5.1

编辑

conf/hadoop-env.sh

文件

........................................................................................... 11

4.5.2

配置

conf/core-site.xml ....................................................................................................... 11

4.5.3

配置

conf/hdfs-site.xml ....................................................................................................... 12

4.5.4

配置

conf/mapred-site.xml ................................................................................................. 13

4.5.5

配置

conf/masters

和

conf/slaves ....................................................................................... 14

4.6 格式化分布式文件系统 ............................................................................................................. 15

4.7 启动和关闭服务 ........................................................................................................................ 15

五．运行测试

................................................................................................................................ 16

5.1 WORDCOUND .................................................................................................................................. 16

5.2 TERASORT ....................................................................................................................................... 19