[Ambari]==Ambari+Hadoop3集成impala3.2、kudu1.10.0

ambari集成impala组件 === ## 实现目标 当前最新ambari版本2.6.5.0及HDP3.1.5.0已不再发布维护和更新，由cloudera公司发布的CDP替代，CDP属于收费项目，因此推出基于ambari服务管理平台的impala服务组件。 ## 关联项目 * [CDH KUDU on ambari](https://github.com/luckes-yang/ambari-kudu-service) ## 安装前准备 #### 1.配置cdh5或cdh6镜像源： CDH5镜像源： ```shell # cdh5适配impala版本为cdh-impala2.12.0 wget -P /etc/yum.repos.d/ https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/cloudera-cdh5.repo ``` CDH6镜像源： ```shell # cdh6适配kudu版本为cdh-impala3.2.0 echo "[cloudera-cdh6.3.2] # Packages for Cloudera's Distribution for Hadoop, Version 6.3.2, on RedHat or CentOS 7 x86_64 name=Cloudera's Distribution for Hadoop, Version 5 baseurl=https://archive.cloudera.com/cdh6/6.3.2/redhat7/yum/ gpgkey =https://archive.cloudera.com/cdh6/6.3.2/redhat7/yum/RPM-GPG-KEY-cloudera gpgcheck = 1" > /etc/yum.repos.d/cloudera-cdh6.3.2.repo ``` *无网络环境或网络环境差的情况下，可以将cdh5镜像源制作成本地镜像源进行安装* ## 安装步骤 #### 1.查看当前HDP版本 ```shell VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'` echo $VERSION ``` #### 2.下载并解压release版本插件包 ```shell git clone https://github.com/luckes-yang/ambari-impala-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/IMPALA ``` #### 3.重启ambari-server ```shell ambari-server restart ``` #### 4.修改配置 * hdfs-site.xml ```xml <property> <name>dfs.client.read.shortcircuit</name> <value>true</value> </property> <property> <name>dfs.domain.socket.path</name> <value>/var/run/hdfs-sockets/dn</value> </property> <property> <name>dfs.client.file-block-storage-locations.timeout.millis</name> <value>10000</value> </property> <property> <name>dfs.datanode.hdfs-blocks-metadata.enabled</name> <value>true</value> </property> ``` #### 5.在ambari web ui进行组件安装 略 #### 6.效果截图 版本效果：<br>  summary:  configuration:  若无法显示截图，是由于github的图片服务器访问问题，在本地hosts文件中添加如下映射即可 ```shell 192.30.253.112 Build software better, together 192.30.253.119 gist.github.com 151.101.184.133 assets-cdn.github.com 151.101.184.133 raw.githubusercontent.com 151.101.184.133 gist.githubusercontent.com 151.101.184.133 cloud.githubusercontent.com 151.101.184.133 camo.githubusercontent.com 151.101.184.133 avatars0.githubusercontent.com 151.101.184.133 avatars1.githubusercontent.com 151.101.184.133 avatars2.githubusercontent.com 151.101.184.133 avatars3.githubusercontent.com 151.101.184.133 avatars4.githubusercontent.com 151.101.184.133 avatars5.githubusercontent.com 151.101.184.133 avatars6.githubusercontent.com 151.101.184.133 avatars7.githubusercontent.com 151.101.184.133 avatars8.githubusercontent.com ```