Central Limit Theorem

The central limit theorem, which is a statistical theory, states that when a large sample size has a finite variance, the samples will be normally distributed, and the mean of samples will be approximately equal to the mean of the whole population.

In other words, the central limit theorem states that for any population with mean and standard deviation, the distribution of the sample mean for sample size N has mean μ and standard deviation σ/√n.

As the sample size gets bigger and bigger, the mean of the sample will get closer to the actual population mean. If the sample size is small, the actual distribution of the data may or may not be normal, but as the sample size gets bigger, it can be approximated by a normal distribution. This statistical theory is useful in simplifying analysis while dealing with stock indexes and much more.

The CLT can be applied to almost all types of probability distributions. But there are some exceptions. For example, if the population has a finite variance. Also, this theorem applies to independent, identically distributed variables. It can also be used to answer the question of how big a sample you want. Remember that as the sample size grows, the standard deviation of the sample average falls because it is the population standard deviation divided by the square root of the sample size. This theorem is an important topic in statistics. In many real-time applications, a certain random variable of interest is a sum of a large number of independent random variables. In such situations, we can use the CLT to justify using the normal distribution.

In this article, students can learn the central limit theorem formula, definition and examples. 

Table of Contents

1. Statement
2. Formula
3. Proof
4. Solved Examples

Central Limit Theorem Statement

The central limit theorem states that whenever a random sample of size n is taken from any distribution with mean and variance, then the sample mean will be approximately a normal distribution with mean and variance. The larger the value of the sample size, the better the approximation of the normal.

Assumptions of the Central Limit Theorem

• The sample should be drawn randomly following the condition of randomisation.
• The samples drawn should be independent of each other. They should not influence the other samples.
• When the sampling is done without replacement, the sample size shouldn’t exceed 10% of the total population.
• The sample size should be sufficiently large.

Formula

The formula for the central limit theorem is given below:

Proof

Consider x₁, x₂, x₃,……,x_n are independent and identically distributed with mean μ and finite variance σ², then any random variable Z_n as,

Here,

Then, the distribution function of Z_n converges to the standard normal distribution function as n increases without any bound.

Again, define a random variable U_i by

E(U_i) = 0 and V(U_i) = 1

Thus, the moment-generating function can be written as

Also,

Since x_i are random independent variables, U_i are also independent.

This implies,

or

As per Taylor series expansion:

Then,

Multiply each term by n, and as n → ∞, all terms but the first go to zero.

Which is the moment-generating function for a standard normal random variable.

Steps

The steps used to solve the problem of the central limit theorem that are either involving ‘>’ ‘<’ or “between” are as follows:

1) The information about the mean, population size, standard deviation, sample size and a number that is associated with “greater than”, “less than”, or two numbers associated with both values for a range of “between” is identified from the problem.

2) A graph with a centre as the mean is drawn. 

3) 

4) The z-table is referred to find the ‘z’ value obtained in the previous step.

5) Case 1: Central limit theorem involving “>”.

Subtract the z-score value from 0.5.

Case 2: Central limit theorem involving “<”.

Add 0.5 to the z-score value.

Case 3: Central limit theorem involving “between”.

Step 3 is executed.

6) The z-value is found along with the x-bar.

The last step is common to all three cases, that is, to convert the decimal obtained into a percentage.

Also, read

Mean Value Theorem

Correlation Coefficient

Examples on Central Limit Theorem

Example 1:

20 students are selected at random from a clinical psychology class; find the probability that their mean GPA is more than 5. If the average GPA scored by the entire batch is 4.91, the standard deviation is 0.72.

Solution:

Here,

Population mean = μ = 4.91

Population standard deviation= σ = 0.72

Sample size = n = 20 (which is less than 30)

Since the sample size is smaller than 30, use the t-score instead of the z-score, even though the population standard deviation is known.

Substituting the values, we have

Now, find the t-score:

For this problem, the raw score x = 5

Find the probability for the t value using the t-score table. The degree of freedom here would be:

Df = 20 – 1 = 19

P(t ≤ 0.559) = 0.7087

P(t > 0.559) = 1 – 0.7087 = 0.2913

Thus, the probability that the score is more than 5 is 9.13 %.

Example 2:

The average weight of a water bottle is 30 kg, with a standard deviation of 1.5 kg. If a sample of 45 water bottles is selected at random from a consignment and their weights are measured, find the probability that the mean weight of the sample is less than 28 kg.

Solution:

Population mean: μ = 30 kg

Population standard deviation: σ = 1.5 Kg

Sample size: n = 45 (which is greater than 30)

Using the z-score, we have

The sample standard deviation:

And,

Find the z-score for the raw score of x = 28 kg

= (28 – 30)(6.7082) = -0.2981

Using the z-score table OR normal CDF function on a statistical calculator,

P(z < -0.2981) = 0.3828

Thus, the probability that the weight of the cylinder is less than 28 kg is 38.28%.

Example 3: The record of weights of the female population follows a normal distribution. Its mean and standard deviation are 65 kg and 14 kg, respectively. If a researcher considers the records of 50 females, then what would be the standard deviation of the chosen sample?

Solution:

Mean of the population μ = 65 kg

The standard deviation of the population = 14 kg

Sample size n = 50

Standard deviation is given by

= 14/√50

= 14/7.071 

= 1.97

Applications of Central Limit Theorem

1] The sample distribution is assumed to be normal when the distribution is unknown or not normally distributed according to the central limit theorem. This method assumes that the given population is distributed normally. It helps in data analysis.

2] The sample mean deviation decreases as we increase the samples taken from the population, which helps in estimating the mean of the population more accurately.

3] The sample mean is used to create a range of values which likely includes the population mean.

4] The concept of the central limit theorem is used in election polls to estimate the percentage of people supporting a particular candidate as confidence intervals.

5] CLT is used in calculating the mean family income in a particular country.

6] It is used in rolling many identical, unbiased dice.

7] The probability distribution for the total distance covered in a random walk will approach a normal distribution.

8] Flipping many coins will result in a normal distribution for the total number of heads (or, equivalently total number of tails).

9] By looking at the sample distribution, CLT can tell whether the sample belongs to a particular population.

10] It enables us to make conclusions about the sample and population parameters and assists in constructing good machine-learning models.