没有合适的资源?快使用搜索试试~ 我知道了~
In this lecture, we describe two proofs of a central theorem of mathematics, namely the central limit theorem. One will be using cumulants, and the other using moments. Actually, our proofs won’t be entirely formal, but we will explain how to make them formal.
资源推荐
资源详情
资源评论
Two Proofs of the Central Limit Theorem
Yuval Filmus
January/February 2010
In this lecture, we describe two proofs of a central theorem of mathemat-
ics, namely the central limit theorem. One will be using cumulants, and the
other using moments. Actually, our proofs won’t be entirely formal, but we
will explain how to make them formal.
1 Central Limit Theorem
What it the central limit theorem? The theorem says that under rather gen-
eral circumstances, if you sum independent random variables and normalize
them accordingly, then at the limit (when you sum lots of them) you’ll get a
normal distribution.
For reference, here is the density of the normal distribution N(µ, σ
2
) with
mean µ and variance σ
2
:
1
√
2πσ
2
e
−
(x−µ)
2
2σ
2
.
We now state a very weak form of the central limit theorem. Suppose that
X
i
are independent, identically distributed random variables with zero mean
and variance σ
2
. Then
X
1
+ ··· + X
n
√
n
−→ N(0, σ
2
).
Note that if the variables do not have zero mean, we can always normalize
them by subtracting the expectation from them.
The meaning of Y
n
−→ Y is as follows: for each interval [a, b],
Pr[a ≤ Y
n
≤ b] −→ Pr[a ≤ Y ≤ b].
1
This mode of convergence is called convergence in distribution.
The exact form of convergence is not just a technical nicety — the normal-
ized sums do not converge uniformly to a normal distribution. This means
that the tails of the distribution converge more slowly than its center. Es-
timates for the speed of convergence are given by the Berry-Ess´een theorem
and Chernoff’s bound.
The central limit theorem is true under wider conditions. We will be
able to prove it for independent variables with bounded moments, and even
more general versions are available. For example, limited dependency can
be tolerated (we will give a number-theoretic example). Moreover, random
variables not having moments (i.e. E[X
n
] doesn’t converge for all n) are
sometimes well-behaved enough to induce convergence. Other problematical
random variable will converge, under a different normalization, to an α-stable
distribution (look it up!).
2 Normal Distribution and Meaning of CLT
The normal distribution satisfies a nice convolution identity:
X
1
∼ N(µ
1
, σ
2
1
), X
2
∼ N(µ
2
, σ
2
2
) =⇒ X
1
+ X
2
∼ N(µ
1
+ µ
2
, σ
2
1
+ σ
2
2
).
Moreover, we can scale a normally distributed variable:
X ∼ N(µ, σ
2
) =⇒ cX ∼ N(cµ, c
2
σ
2
).
Even more exciting, we can recover the normal distribution from these prop-
erties. The equation N(0, 1)+N(0, 1) =
√
2N(0, 1) in essence defines N(0, 1)
(up to scaling), from which the entire ensemble can be recovered.
These properties point at why we should expect the normalized sums in
the central limit theorem to converge to a normal variable. Indeed, suppose
the convergence is to a hypothetical distribution D. From the equations
X
1
+ ··· + X
n
√
n
−→ D
X
1
+ ··· + X
2n
√
2n
−→ D
we would expect D + D =
√
2D, so D must be normal. Therefore the real
content of the central limit theorem is that convergence does take place. The
2
剩余12页未读,继续阅读
资源评论
三鱼纹
- 粉丝: 0
- 资源: 5
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
最新资源
资源上传下载、课程学习等过程中有任何疑问或建议,欢迎提出宝贵意见哦~我们会及时处理!
点击此处反馈
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功