目录
1. 简介 .............................................................................................................................................................................. 4
2. 了解高可用性架构 .................................................................................................................................................... 4
2.1 高可用性设计概述 ................................................................................................................................................ 4
2.2 处理 HDFS 命名空间的更改............................................................................................................................... 5
2.3 访问 Shared Edits 目录的机制 ......................................................................................................................... 5
2.3.1 为共享存储使用 NFS ........................................................................................................................................ 5
2.3.2 为共享存储使用 Quorum Journal Manager ............................................................................................. 6
2.4 QuorumJournalManager 的功能 ..................................................................................................................... 6
2.5 QuorumJournalManager 设计概述 ................................................................................................................ 7
2.6 发送块位置信息到 NameNode ......................................................................................................................... 7
2.7 和 NameNode 的客户端通信 ............................................................................................................................ 8
2.8 NameNode 故障恢复 ............................................................................................................................................ 8
2.8.1 人工故障恢复 ..................................................................................................................................................... 8
2.8.2 自动故障恢复 ..................................................................................................................................................... 8
2.9 通过隔离防止脑裂现象 ..................................................................................................................................... 10
2.9.1 Fencing of the Shared Edit Directory on a NFS..................................................................................... 10
2.9.2 Fencing of the Shared Edit Directory in QuorumJournalManager ............................................... 10
3. 设置高可用性的要求 .............................................................................................................................................. 12
4. 设置高可用性 ........................................................................................................................................................... 13
4.1 使用 QuorumJournalManager 进行共享存储 ........................................................................................... 13
5. 配置 CDH 其他组件使用 HDFS 高可用性 ........................................................................................................ 20
5.1 配置 Hive Metastore 使用 HDFS 高可用性 ................................................................................................ 20
5.2 配置 Hue 使用 HDFS 高可用性 ...................................................................................................................... 23
5.3 配置 Impala 使用 HDFS 高可用性 ................................................................................................................ 29
6. 参考 ............................................................................................................................................................................ 30
评论0