![](https://csdnimg.cn/release/download_crawler_static/89144330/bg4.jpg)
Contents
1 Introduction 7
2 Entropy, Relative Entropy and Mutual Information 9
3 The Asymptotic Equipartition Property 49
4 Entropy Rates of a Stochastic Process 61
5 Data Compression 97
6 Gambling and Data Compression 139
7 Channel Capacity 163
8 Differential Entropy 203
9 Gaussian channel 217
10 Rate Distortion Theory 241
11 Information Theory and Statistics 273
12 Maximum Entropy 307
13 Universal Source Co ding 323
14 Kolmogorov Complexity 337
15 Network Information Theory 347
16 Information Theory and Portfolio T heory 393
17 Inequalities in Information T heory 407
3