目录
第 1 章 部署环境 .............................................................................................................................3
1.1 系统配置 ............................................................................................................................3
1.2 系统依赖配置 ....................................................................................................................4
1.2.1 JDK 配置 ..................................................................................................................4
1.2.2 防火墙配置 .............................................................................................................5
1.2.3 主机名配置 .............................................................................................................5
1.2.4 免密 ssh 配置 .........................................................................................................6
1.3 依赖组件配置 ....................................................................................................................6
1.3.1 Hadoop 配置 ............................................................................................................6
1.3.2 Mysql 配置 ............................................................................................................18
1.3.3 Hive 配置 ..............................................................................................................20
1.3.4 Zookeeper 配置 ....................................................................................................27
1.3.5 HBase 配置 ............................................................................................................30
1.3.6 Kafka 配置 ............................................................................................................34
1.3.7 Flulme 配置 ..........................................................................................................36
1.3.8 Spark 配置 ............................................................................................................37
1.3.9 Atlas 配置..............................................................................................................38
1.3.10 Azkaban 配置 .....................................................................................................41
第 2 章 模块安装与配置 ...............................................................................................................49
2.1 总体说明 ..........................................................................................................................49
2.2 数据库数据初始化 ..........................................................................................................49
2.3 系统安装部署 ..................................................................................................................49
2.3.1 数据提取、存储子系统........................................................................................49
2.3.2 分析结果可视化展示子系统................................................................................53
2.3.3 分析、迁移定时任务子系统................................................................................54
2.4 模块使用 ..........................................................................................................................56
第 3 章 其他事项 ...........................................................................................................................57
3.1 故障排查 ..........................................................................................................................57
3.1.1 hive metastroe 的问题 ........................................................................................57
3.1.2hiveserver2 的启动问题 ......................................................................................58
3.2 Q&A ....................................................................................................................................59
评论0