Central Limit Theorem Proof

Let the independent random variables be X1, X2, X3, . . . . , Xn which are identically distributed and where their mean is zero(μ = 0) and their variance is one(σ2 = 1).

The Z score is given as, Z = [Tex]\dfrac{\overline X – \mu}{\frac{\sigma}{\sqrt n}} [/Tex]

Here, according to Central Limit Theorem, Z approximates to Normal Distribution as the value of n increases.

Let m(t) be the Moment Generating Function of Xi

⇒ M(0) = 1

⇒ M'(1) = E(Xi) = μ = 0

⇒ M”(0) = E(Xi2) = 1

The Moment Generating Function for Xi/√n is given as E[etXi/√n]

Since, X1 X2, X3 . . . Xn are independent, hence the Moment Generating Function for (X1 + X2 + X3 + . . . + Xn)/√n is given as [M(t/√n)]n

Let us assume as function

f(t) = log M(t)

⇒ f(0) = log M(0) = 0

⇒ f'(0) = M'(0)/M(0) = μ/1 = μ

⇒ f”(0) = (M(0).M”(0) – M'(0)2)/M'(0)2 = 1

Now, using L’ Hospital Rule we will find t/√n as t2/2

⇒ [M(t/√n)]2 = [ef(t/√n)]n

⇒ [enf(t/√n)] = e^(t2/2)

Thus the Central Limit Theorem has been proved by getting Moment Generating Function of a Standard Normal Distribution.

Central Limit Theorem

The Central Limit Theorem in Statistics states that as the sample size increases and its variance is finite, then the distribution of the sample mean approaches normal distribution irrespective of the shape of the population distribution. The query that how much the sample size should increase can be answered that if the sample size is greater than 30 then the statement of the Central Limit Theorem holds.

The central limit theorem posits that the distribution of sample means will invariably conform to a normal distribution provided the sample size is sufficiently large. This holds regardless of the underlying distribution of the population, be it normal, Poisson, binomial, or any alternative distribution.

In this article on the Central Limit Theorem, we will learn about the Central Limit Theorem definition, Central Limit Theorem examples, Central Limit Theorem Formulas, proof of the Central Limit Theorem, and Central Limit Theorem applications.

Table of Content

  • Central Limit Theorem in Statistics
    • Central Limit Theorem Definition
  • Central Limit Theorem Formula
  • Central Limit Theorem Proof
  • Central Limit Theorem Examples
  • Assumptions of the Central Limit Theorem
  • Steps to Solve Problems on Central Limit Theorem
  • Central Limit Theorem Applications
  • Solved Examples on Central Limit Theorem
  • Summary – Central Limit Theorem in Statistics

Similar Reads

Central Limit Theorem in Statistics

The Central Limit Theorem explains that the sample distribution of the sample mean resembles the normal distribution irrespective of the fact that whether the variables themselves are distributed normally or not. The Central Limit Theorem is often called CLT in abbreviated form....

Central Limit Theorem Formula

Let us assume we have a random variable X. Let σ be its standard deviation and μ is the mean of the random variable. Now as per the Central Limit Theorem, the sample mean [Tex]\overline{X} [/Tex] will approximate to the normal distribution which is given as [Tex]\overline{X} [/Tex] ⁓ N(μ, σ/√n). The Z-Score of the random variable [Tex]\overline{X} [/Tex] is given as Z = [Tex]\dfrac{\overline x – \mu}{\frac{\sigma}{\sqrt n}} [/Tex]. Here [Tex]\overline x [/Tex] is the mean of [Tex]\overline X [/Tex]. The image of the formula is attached below...

Central Limit Theorem Proof

Let the independent random variables be X1, X2, X3, . . . . , Xn which are identically distributed and where their mean is zero(μ = 0) and their variance is one(σ2 = 1)....

Central Limit Theorem Examples

Let’s say we have a large sample of observations and each sample is randomly produced and independent of other observations. Calculate the average of the observations, thus having a collection of averages of observations. Now as per the Central Limit Theorem, if the sample size is adequately large, then the probability distribution of these sample averages will approximate to a normal distribution....

Assumptions of the Central Limit Theorem

The Central Limit Theorem is valid for the following conditions:...

Steps to Solve Problems on Central Limit Theorem

Problems of Central Limit Theorem that involves >, < or between can be solved by the following steps:...

Central Limit Theorem Applications

Central Limit Theorem is generally used to predict the characteristics of a population from a set of sample. It can be applied in various fields. Some of the applications Central Limit Theorem are mentioned below:...

Solved Examples on Central Limit Theorem

Example 1. The male population’s weight data follows a normal distribution. It has a mean of 70 kg and a standard deviation of 15 kg. What would the mean and standard deviation of a sample of 50 guys be if a researcher looked at their records?...

Summary – Central Limit Theorem in Statistics

The Central Limit Theorem (CLT) is a cornerstone of statistical theory that establishes the conditions under which the mean of a large number of independent, identically distributed random variables, irrespective of the population’s distribution, will approximate a normal distribution....

Central Limit Theorem in Statistics – FAQs

What is the Central Limit Theorem?...