分布式系统工程实践
杨传辉
日照@淘宝
V 0.1
2010-10
分布式系统工程实践 ....................................................................................................................... 1
1 引言........................................................................................................................................... 3
2 基础知识 ................................................................................................................................... 3
2.1 硬件基础 ....................................................................................................................... 4
2.2 性能估算 ....................................................................................................................... 4
2.3 CAP ................................................................................................................................ 6
2.4 一致性模型 ................................................................................................................... 7
2.5 NOSQL 与 SQL ............................................................................................................... 9
2.6 Two-Phase commit ...................................................................................................... 10
2.7 Paxos ........................................................................................................................... 11
3 关键技术实现 ......................................................................................................................... 12
3.1 网络编程框架 ............................................................................................................. 12
3.2 HA 与 Replication ........................................................................................................ 13
3.3 分裂 ............................................................................................................................. 14
3.4 迁移 ............................................................................................................................. 15
3.5 负载均衡 ..................................................................................................................... 16
3.6 Chubby ........................................................................................................................ 16
3.7 分布式事务 ................................................................................................................. 17
3.8 Copy-on-write 与 Snapshot ........................................................................................ 17
3.9 操作日志与 checkpoint .............................................................................................. 19
3.10 列式存储与压缩 ..................................................................................................... 19
4 通用存储系统分类 ................................................................................................................. 20
5 典型存储系统工程实现 ......................................................................................................... 21
5.1 单机存储引擎 ............................................................................................................. 21
5.1.1 随机访问存储引擎 ......................................................................................... 21
5.1.2 通用存储引擎 ................................................................................................. 22
5.1.3 单机存储优化 ................................................................................................. 23
5.2 SQL 数据库 ................................................................................................................. 23
5.3 线上最终一致性系统 ................................................................................................. 24
5.4 线上弱一致性系统 ..................................................................................................... 26
5.5 半线上及线下系统 ..................................................................................................... 29
5.5.1 两层结构 ......................................................................................................... 29
5.5.2 GFS................................................................................................................... 30
5.5.3 Bigtable ............................................................................................................ 31
6 通用计算系统分类 ................................................................................................................. 32
7 典型计算系统工程实现 ......................................................................................................... 33
- 1
- 2
- 3
- 4
前往页