Lição 77 — Teorema Central do Limite
A média de n v.a. iid converge à normal independente da distribuição original — a lei mais importante da estatística. Demonstração via função característica, velocidade Berry-Esseen, aplicações de inferência.
Used in: 2.º ano do EM (16-17 anos) · Math B japonês §4.4 · Stochastik LK alemão · H2 Math singapurense cap. 21
The Central Limit Theorem (CLT) states that the mean of independent and identically distributed random variables with mean and finite variance converges in distribution to a normal distribution with parameters and — regardless of the original distribution. This explains why the bell curve appears in natural data, measurement errors, and sample means.
Rigorous notation, full derivation, hypotheses
Formal statement and proof
Lindeberg-Lévy Version
"The central limit theorem is the unofficial sovereign of probability theory." — Grinstead & Snell, Introduction to Probability, §9.1
Version for sums
If , then for large .
Convergence rate: Berry-Esseen inequality
Proof sketch via characteristic function
Let (zero mean, unit variance). Taylor expansion of :
For :
But is the characteristic function of . The Lévy continuity theorem concludes .
When the CLT fails
Essential hypotheses
- Independence (minimally sufficient; relaxable to -mixing).
- Finite variance .
- sufficiently large — practical rule: for non-highly-skewed distributions; for high skewness.
Worked examples
Exercise list
45 exercises · 11 with worked solution (25%)
- Ex. 77.1Application
exponential with , . Write the approximate distribution of and calculate .
Show solution
exponential with and . By CLT: . Standard deviation of the mean: . - Ex. 77.2Application
. Determine and and write the approximate distribution of by CLT.
Show solution
: , . By CLT: .Show step-by-step (with the why)
- Calculate parameters of : ; .
- Apply CLT with : .
- Standard deviation: .
- Ex. 77.3Application
Roll 100 fair dice. Determine the approximate distribution of the sum , with and .
Show solution
Fair die: , . Sum of 100: . - Ex. 77.4ApplicationAnswer key
. Write the approximate distribution of by CLT and calculate the standard deviation of the sample proportion.
Show solution
: , . CLT: . . - Ex. 77.5Application
, , . Calculate the standard deviation of .
Show solution
. - Ex. 77.6Application
With , , , calculate .
Show solution
. . .Show step-by-step (with the why)
- Calculate .
- Standardize: .
- Table: .
- Ex. 77.7Application
With , , , calculate .
Show solution
. . Same value as 77.6 by symmetry of the normal. - Ex. 77.8Application
with , , . Calculate .
Show solution
. , . — 68% rule. - Ex. 77.9Application
Sum of 50 iid r.v. with , . Calculate .
Show solution
. . . .Show step-by-step (with the why)
- Distribution of the sum: .
- .
- Standardize: .
- .
- Ex. 77.10Application
with . How many observations for 95% CI with margin of error ?
Show solution
95% CI half-width = . . . Round up: .Show step-by-step (with the why)
- Margin of error at 95%: .
- Isolate .
- Square: .
- Round up: .
- Ex. 77.11Understanding
When is multiplied by 4, the standard deviation of ():
Show solution
. If : . The standard deviation of the mean is cut in half. - Ex. 77.12UnderstandingAnswer key
has a very skewed distribution (skewness = 3). For what sample size is the CLT reasonable?
Show solution
Berry-Esseen: error , where . High skewness increases , requiring larger for convergence. Rule of thumb: for highly skewed distributions. - Ex. 77.13Application
Test scores with , . Sample . Calculate .
Show solution
. . .Show step-by-step (with the why)
- Standard error of the mean: .
- Standardize the value 75: .
- Probability: .
- Ex. 77.14Application
With , , , calculate .
Show solution
. . Same value as 77.13 by symmetry of the normal. - Ex. 77.15Application
With , , and , construct a 95% CI for .
Show solution
. 95% CI: . Interval: . - Ex. 77.16Application
Package weight: g, g, . Calculate .
Show solution
. . . - Ex. 77.17Application
With , , , calculate .
Show solution
; . . - Ex. 77.18ApplicationAnswer key
Response time: ms, ms, . What is the 95% SLA limit?
Show solution
. 95th percentile: ms. - Ex. 77.19Application
Roll a die 1,000 times. Calculate .
Show solution
Die: , . . . . - Ex. 77.20Application
Using the distribution of the sum of 1,000 die rolls, calculate .
Show solution
. . . . Same result as 77.19 — confirms equivalence. - Ex. 77.21Application
(, ). Calculate .
Show solution
: , . . . . - Ex. 77.22ApplicationAnswer key
Election survey: , . Calculate .
Show solution
. . .Show step-by-step (with the why)
- Standard error of the proportion: .
- Standardize: .
- .
- Ex. 77.23Modeling
You hold 50 stocks with daily return , (independent). What is the distribution of your portfolio's mean daily return?
Show solution
50 independent stocks with daily return , . . . Diversification reduced risk from 2% to 0.28%. - Ex. 77.24Modeling
ML model: individual error . Calculate the standard deviation of mean error over 1,000 predictions and the 95% CI margin of error.
Show solution
. 95% CI: margin . - Ex. 77.25Modeling
Satisfaction survey: margin of error at 95%, unknown. What is the minimum ?
Show solution
Margin of error 3% at 95%, worst case : . This is why "3% margin of error" Brazilian surveys have ~1000 respondents. - Ex. 77.26Modeling
Batch of 500 items: g, g. Determine the distribution of .
Show solution
. g. Expected total weight: 50 kg with standard deviation ~112 g. - Ex. 77.27Modeling
Bus wait time: min. Calculate for 50 passengers.
Show solution
: , . . . . - Ex. 77.28Modeling
On an X-bar control chart with , how are the control limits (UCL and LCL) calculated?
Show solution
Shewhart X-bar chart: UCL/LCL = . The 3 comes from — acceptable false-alarm rate.Show step-by-step (with the why)
- By CLT: of subgroup of size is approximately .
- 3-sigma limits capture 99.73% of means when the process is in control.
- UCL = ; LCL = .
- For : total width = .
- Ex. 77.29ModelingAnswer key
Survey with margin of error at 95% confidence, unknown. What is the minimum necessary ?
Show solution
Margin = . For (worst case) and margin = 5%: . Round up: . Half the margin (3%) requires almost three times more respondents (1067). - Ex. 77.30ModelingAnswer key
Call time: min, min, 100 calls. Calculate .
Show solution
. . . . - Ex. 77.31ModelingAnswer key
A/B test: 10,000 visitors per variant; conversion A = 5%, B = 6%. Is the 1 p.p. lift statistically significant? Calculate and the p-value.
Show solution
Observed difference: 1%. SE: . . p-value < 0.001. A 1 p.p. difference is statistically significant with 10,000 users per variant.Show step-by-step (with the why)
- Pooled estimator: .
- SE: .
- . p-value .
- Conclusion: reject — difference is significant.
- Ex. 77.32Understanding
Which option correctly describes the CLT?
Show solution
The CLT talks about the distribution of the sample mean (or standardized sum) — not the original distribution. The original distribution stays the same; what converges to normal is the statistic . - Ex. 77.33Understanding
Why does the classical CLT not apply to the Cauchy distribution?
Show solution
The Cauchy characteristic function is — no second derivative at (infinite variance). The Taylor expansion leading to the limit doesn't work. The mean of Cauchys is still Cauchy. - Ex. 77.34UnderstandingAnswer key
When simulating means of die rolls for , how does the histogram shape evolve?
Show solution
Simulating means of fair die rolls: = flat uniform; = triangular-trapezoidal shape; = indistinguishable from normal. Convergence is visible and rapid. - Ex. 77.35Application
Distance of fly-balls: ft. Sample of 49 balls. Calculate .
Show solution
Baseball fly-balls: ft, . . . . . - Ex. 77.36ProofAnswer key
Show that the CLT implies the Weak Law of Large Numbers.
Show solution
From CLT: . Chebyshev: . So — Law of Large Numbers. CLT is stronger: it tells how the distribution of the error behaves as it converges. - Ex. 77.37Proof
Sketch the proof of the CLT via characteristic function, indicating the necessary hypotheses.
Show solution
Steps: (1) Define . (2) . (3) . (4) Lévy's theorem concludes convergence in distribution. Requires only finite variance (Lindeberg-Lévy hypothesis). - Ex. 77.38ApplicationAnswer key
Average time to fill IRS Form 1040: h, h. Sample of 36 taxpayers. Calculate the distribution of and .
Show solution
IRS Form 1040 time: h, h. . . . — practically impossible. - Ex. 77.39Application
Marathon times: min, min. Sample of 49 runs. Calculate .
Show solution
Marathon times: min, . . . ; . . - Ex. 77.40Modeling
Percentage of fat calories: , . Sample of 16 people. Calculate .
Show solution
% fat calories: , . . . . . - Ex. 77.41Modeling
Gasoline price (Bay Area): dollars, dollars. Sample of 16 stations. What is the distribution of and ?
Show solution
Gasoline Bay Area: , . . . . . - Ex. 77.42ModelingAnswer key
Air conditioning service: mean time 1 h, h. Budget of 1.1 h per technician, 70 units. Is there sufficient budget with 80% confidence?
Show solution
Air conditioning service: h, h. units. . . . 80% chance of not overrunning the budget. - Ex. 77.43Challenge
Challenge — Lindeberg condition. The Lindeberg-Feller CLT generalizes the CLT to independent but non-i.d. variables. What is the essential condition that replaces the identical-distribution hypothesis, and what does it intuitively require?
Show solution
Let be independent (not necessarily i.d.) with , . Define . The Lindeberg condition requires that for every : . Intuitively: the contribution of any extreme individual value to total variance must be negligible. If satisfied, .Show step-by-step (with the why)
- Motivation. With i.i.d. variables, classical CLT follows easily from characteristic functions. For non-i.d. variables, we need to prevent a single variable from "dominating" the sum.
- Total variance. . Should grow with .
- Lindeberg condition. For each , the fraction of variance explained by large deviations (above ) must go to zero.
- Practical consequence. If for each (Feller condition), the Lindeberg condition is satisfied for variables with finite fourth moment.
- Counterexample. If concentrates all variance (e.g. ), Lindeberg fails and CLT does not hold.
The Lindeberg-Feller CLT is the most general CLT result: it generalizes i.i.d. requiring only that no individual variable "dominates" variance asymptotically.
- Ex. 77.44Challenge
Challenge — Berry-Esseen bound. The Berry-Esseen theorem provides a quantitative bound for the speed of CLT convergence. For i.i.d. variables with third absolute moment , what is the correct form of the bound on the maximum approximation error?
Show solution
The Berry-Esseen theorem states: if are i.i.d. with , and , then , with universal constant . Example: for : , , error .Show step-by-step (with the why)
- Statement. Berry-Esseen: with (best constant known in 2024).
- Ingredients. (third absolute moment); normalizes by scale.
- Convergence rate. The error is — same rate as standard deviation of the sample mean.
- Application Bernoulli(1/2). , (since ). Error . For : error — reasonable.
Berry-Esseen quantifies the "n=30 rule": the maximum approximation error decreases as , but the constant depends on distribution skewness (via ). More skewed distributions need larger .
- Ex. 77.45Challenge
Challenge — Shewhart control chart. In statistical process control (SPC), limits are used to detect out-of-control processes. Based on the CLT, calculate the probability of a false alarm (process in control but point outside limits) and the ARL₀ (average number of subgroups until the first false alarm).
Show solution
By Shewhart's 3-sigma rule: control limits are . By CLT, when the process is in control. Therefore , or 0.27% — a false alarm occurs about once per 370 subgroups. The average number of subgroups until the first false alarm (ARL₀) is .Show step-by-step (with the why)
- Shewhart control chart. Each point is the mean of a subgroup of size . Upper control limit (UCL) = ; lower control limit (LCL) = .
- CLT justifies using . Regardless of individual distribution (when – for non-highly-skewed processes).
- Probability of false alarm. .
- ARL₀. Average number of subgroups until first false alarm = . The higher the ARL₀, the less the chart "cries wolf".
- Why 3σ? Trade-off: false alarm rare (0.27%) without excessive ARL₀; 2-sigma limits would give 4.5% false alarm, too frequent.
Shewhart's 3-sigma rule (1924) is the industrial application of CLT. The ARL₀ ≈ 370 is the gold standard in statistical process control (SPC).
Sources
- OpenIntro Statistics (4th ed) — Diez, Çetinkaya-Rundel, Barr · 2019 · CC-BY-SA. Primary source for exercises 77.2, 77.4, 77.8, 77.11, 77.14–17, 77.22–23, 77.25–26, 77.28, 77.30, 77.33–34.
- OpenStax Statistics — Illowsky, Dean · 2022 · CC-BY. Source for exercises 77.1, 77.3, 77.5–7, 77.9–10, 77.12–13, 77.18–19, 77.21, 77.24, 77.27, 77.29, 77.31, 77.35 and examples 1–3.
- Introduction to Probability (Grinstead-Snell) — Grinstead, Snell · 2006 · CC Free · §9 "Central Limit Theorem". Source for challenge exercises 77.43–77.44.
- Introduction to Probability (Grinstead-Snell) — Grinstead, Snell · Dartmouth · GNU FDL. Source for exercises 77.19–20, 77.26, 77.36–37 and example 5.