没有合适的资源?快使用搜索试试~ 我知道了~
hortonworks官方安装文档
5星 · 超过95%的资源 需积分: 31 50 下载量 138 浏览量
2013-10-30
00:38:15
上传
评论 1
收藏 372KB PDF 举报
温馨提示
试读
49页
英文文档,但是比较全面和详细,Install Hadoop Using Apache Ambari
资源推荐
资源详情
资源评论
Hortonworks Data Platform May 15, 2013
ii
Hortonworks Data Platform : Installing Hadoop Using Apache Ambari
Copyright © 2012, 2013 Hortonworks, Inc. Some rights reserved.
The Hortonworks Data Platform, powered by Apache Hadoop, is a massively scalable and 100% open
source platform for storing, processing and analyzing large volumes of data. It is designed to deal with
data from many sources and formats in a very quick, easy and cost-effective manner. The Hortonworks
Data Platform consists of the essential set of Apache Hadoop projects including MapReduce, YARN,
Hadoop Distributed File System (HDFS), HCatalog, Pig, Hive, HBase, Zookeeper, and Ambari. Hortonworks
is the major contributor of code and patches to many of these projects. These projects have been
integrated and tested as part of the Hortonworks Data Platform release process and installation and
configuration tools have also been included.
Unlike other providers of platforms built using Apache Hadoop, Hortonworks contributes 100% of our
code back to the Apache Software Foundation. The Hortonworks Data Platform is Apache-licensed and
completely open source. We sell only expert technical support, training and partner-enablement services.
All of our technology is, and will remain free and open source. Please visit the Hortonworks Data Platform
page for more information on Hortonworks technology. For more information on Hortonworks services,
please visit either the Support or Training page. Feel free to Contact Us directly to discuss your specific
needs.
Except where otherwise noted, this document is licensed under
Creative Commons Attribution ShareAlike 3.0 License.
http://creativecommons.org/licenses/by-sa/3.0/legalcode
Hortonworks Data Platform May 15, 2013
iii
Table of Contents
1. Getting Ready to Install .............................................................................................. 1
1.1. Understand the Basics ...................................................................................... 1
1.2. Meet Minimum System Requirements ............................................................... 2
1.2.1. Hardware Recommendations ................................................................. 2
1.2.2. Operating Systems Requirements ........................................................... 2
1.2.3. Browser Requirements ........................................................................... 3
1.2.4. Software Requirements .......................................................................... 3
1.2.5. Database Requirements ......................................................................... 4
1.3. Decide on Deployment Type ............................................................................. 4
1.4. Collect Information ........................................................................................... 4
1.5. Prepare the Environment .................................................................................. 4
1.5.1. Check Existing Installs ............................................................................ 5
1.5.2. Set Up Password-less SSH ....................................................................... 5
1.5.3. Enable NTP on the Cluster and on the Browser Host ............................... 6
1.5.4. Check DNS ............................................................................................. 6
1.5.5. Disable SELinux ...................................................................................... 6
1.5.6. Disable iptables ..................................................................................... 7
1.5.7. Disable PackageKit ................................................................................ 7
1.5.8. Check umask Value ................................................................................ 7
1.6. Optional: Configure the Local Repositories ........................................................ 7
2. Running the Installer ................................................................................................. 10
2.1. Set Up the Bits ............................................................................................... 10
2.1.1. RHEL/CentOS 5.x ................................................................................. 10
2.1.2. RHEL/CentOS 6.x ................................................................................. 11
2.1.3. SLES 11 ................................................................................................ 11
2.2. Set Up the Server ........................................................................................... 12
2.2.1. Setup Options ...................................................................................... 12
2.3. Optional: Set Up LDAP or Active Directory Authentication ............................... 13
2.4. Optional: Change the Ambari Server Port ....................................................... 14
2.5. Start the Ambari Server .................................................................................. 14
3. Installing, Configuring, and Deploying the Cluster ...................................................... 15
3.1. Log into Apache Ambari ................................................................................. 15
3.2. Welcome ........................................................................................................ 15
3.3. Install Options ................................................................................................ 15
3.4. Confirm Hosts ................................................................................................. 16
3.5. Choose Services .............................................................................................. 16
3.6. Assign Masters ............................................................................................... 17
3.7. Assign Slaves and Clients ................................................................................ 17
3.8. Customize Services .......................................................................................... 18
3.8.1. Recommended Memory Configurations for the MapReduce Service ....... 18
3.9. Review ........................................................................................................... 19
3.10. Install, Start and Test .................................................................................... 19
3.11. Summary ...................................................................................................... 19
4. Troubleshooting Ambari Deployments ....................................................................... 20
4.1. Getting the Logs ............................................................................................ 20
4.2. Quick Checks .................................................................................................. 20
4.3. Specific Issues ................................................................................................. 20
4.3.1. Problem: Browser crashed before Install Wizard completed .................. 21
Hortonworks Data Platform May 15, 2013
iv
4.3.2. Problem: Install Wizard reports that the cluster install has failed ............ 21
4.3.3. Problem: “Unable to create new native thread” exceptions in HDFS
DataNode logs or those of any system daemon ............................................. 22
4.3.4. Problem: The “yum install ambari-server” Command Fails ...................... 22
4.3.5. Problem: HDFS Smoke Test Fails ........................................................... 22
4.3.6. Problem: The HCatalog Daemon Metastore Smoke Test Fails ................. 23
4.3.7. Problem: MySQL and Nagios fail to install on RightScale CentOS 5
images on EC2 .............................................................................................. 24
4.3.8. Problem: Trouble starting Ambari on system reboot ............................. 24
4.3.9. Problem: Metrics and Host information display incorrectly in Ambari
Web .............................................................................................................. 24
4.3.10. Problem: On SUSE 11 Ambari Agent crashes within the first 24 hours
...................................................................................................................... 25
4.3.11. Problem: Attempting to Start HBase REST server causes either REST
server or Ambari Web to fail ......................................................................... 25
4.3.12. Problem: Multiple Ambari Agent processes are running, causing re-
register .......................................................................................................... 25
4.3.13. Problem: Some graphs do not show a complete hour of data until
the cluster has been running for an hour ....................................................... 25
4.3.14. Problem: After performing a cluster install the Nagios server is not
started .......................................................................................................... 26
4.3.15. Problem: A service with a customized service user is not appearing
properly in Ambari Web ................................................................................ 26
4.3.16. Problem: Updated configuration changes are not pushed to client/
gateway nodes .............................................................................................. 26
4.3.17. Problem: Trying to upgrade Ambari Server on SLES produces error ...... 27
4.3.18. Problem: Short circuit access failed warning in the HBase log file. ......... 27
5. Appendix: Installing Ambari Agents Manually ............................................................ 29
5.1. RHEL/CentOS v. 5.x and 6.x ............................................................................ 29
5.2. SLES ............................................................................................................... 29
6. Appendix: Using Custom Hostnames ......................................................................... 30
7. Appendix: Upgrading Operating Systems on an Ambari-based Hadoop Installation
...................................................................................................................................... 31
8. Appendix: Upgrading Ambari Server from 1.2.0/1.2.1/1.2.2/1.2.2.5 to 1.2.3.6 ............. 32
8.1. Preparing for upgrade .................................................................................... 32
8.2. Upgrading Ambari server ................................................................................ 32
9. Appendix: Upgrading the HDP Stack from 1.2.0 to 1.2.1 ............................................ 36
10. Configuring Ports .................................................................................................... 40
10.1. HDFS Ports ................................................................................................... 40
10.2. MapReduce Ports ......................................................................................... 40
10.3. Hive Ports ..................................................................................................... 41
10.4. HBase Ports .................................................................................................. 42
10.5. WebHCat Port .............................................................................................. 43
10.6. Ganglia Ports ................................................................................................ 43
10.7. MySQL Ports ................................................................................................. 44
Hortonworks Data Platform May 15, 2013
v
List of Tables
2.1. Download the repo ................................................................................................ 10
2.2. Ambari Server Properties ........................................................................................ 13
6.1. ambari-agent.ini ..................................................................................................... 30
10.1. HDFS Ports ........................................................................................................... 40
10.2. MapReduce Ports ................................................................................................. 41
10.3. Hive Ports ............................................................................................................. 41
10.4. HBase Ports .......................................................................................................... 42
10.5. WebHCat Port ...................................................................................................... 43
10.6. Ganglia Ports ........................................................................................................ 43
10.7. MySQL Ports ......................................................................................................... 44
剩余48页未读,继续阅读
资源评论
- 丿90後灬芣栣性2014-05-12很不错哦,学习了......
- ahopeliu0072014-04-18不错,对我有帮助。
- phantom_v72014-05-07挺全的,照着搭建成功了
- guidguid2015-05-05很好的文档,基本能成功!
hiphophua
- 粉丝: 3
- 资源: 1
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功