清理hdfs,初始化hadoop
rm -rf /data/install/apache/hadoop-2.7.3/hdfs/*
rm -rf /data/install/apache/hadoop-2.7.3/tmp/*
/data/install/apache/hadoop-2.7.3/bin/hadoop namenode -format
zookeeper
/data/install/apache/zookeeper-3.4.9/bin/zkServer.sh start
/data/install/apache/zookeeper-3.4.9/bin/zkServer.sh stop
hadoop
/data/install/apache/hadoop-2.7.3/sbin/start-dfs.sh
/data/install/apache/hadoop-2.7.3/sbin/stop-dfs.sh
yarn
/data/install/apache/hadoop-2.7.3/sbin/start-yarn.sh
/data/install/apache/hadoop-2.7.3/sbin/stop-yarn.sh
hbase
/data/install/apache/hbase-1.2.2/bin/start-hbase.sh
/data/install/apache/hbase-1.2.2/bin/stop-hbase.sh
spark
/data/install/apache/spark-2.0.0-bin-hadoop2.7/sbin/start-all.sh
/data/install/apache/spark-2.0.0-bin-hadoop2.7/sbin/stop-all.sh
启动所有
/data/install/apache/zookeeper-3.4.9/bin/zkServer.sh start && /data/install/apache/hadoop-2.7.3/sbin/start-dfs.sh && /data/install/apache/hadoop-2.7.3/sbin/start-yarn.sh && /data/install/apache/hbase-1.2.2/bin/start-hbase.sh && /data/install/apache/spark-2.0.0-bin-hadoop2.7/sbin/start-all.sh
关闭所有
/data/install/apache/spark-2.0.0-bin-hadoop2.7/sbin/stop-all.sh && /data/install/apache/hbase-1.2.2/bin/stop-hbase.sh && /data/install/apache/hadoop-2.7.3/sbin/stop-yarn.sh && /data/install/apache/hadoop-2.7.3/sbin/stop-dfs.sh && /data/install/apache/zookeeper-3.4.9/bin/zkServer.sh stop
提交任务到spark
/data/install/spark/bin/spark-submit --master spark://ubuntu-test1:7077 --name Data-Analyze --class org.apache.spark.examples.HBaseTest --jars /data/install/hbase/lib/hbase-client-1.2.2.jar,/data/install/hbase/lib/hbase-server-1.2.2.jar,/data/install/hbase/lib/hbase-common-1.2.2.jar,/data/install/hbase/lib/hbase-protocol-1.2.2.jar,/data/install/hbase/lib/guava-12.0.1.jar,/data/install/hbase/lib/htrace-core-3.1.0-incubating.jar,/data/install/hbase/lib/metrics-core-2.2.0.jar ~/lanny-0.0.1-SNAPSHOT.jar tes
/data/install/spark/bin/spark-submit --master spark://ubuntu-test1:7077 --name Data-Analyze --class org.apache.spark.examples.HBaseTest ~/lanny-0.0.1-SNAPSHOT.jar tes
hadoop、zookeeper、hbase、spark集群配置文件
5星 · 超过95%的资源 需积分: 50 125 浏览量
2016-09-13
09:31:03
上传
评论
收藏 16KB ZIP 举报
Trigl
- 粉丝: 560
- 资源: 1