# The Central Limit Theorem

The Central Limit Theorem

The Central Limit Theorem is an important result in statistics that states that subject to certain conditions, averages of multiple random variables tend to follow a normal distribution.

## Discovering the Central Limit Theorem

Discovering the Central Limit Theorem

Let’s “discover” the Central Limit Theorem empirically, by looking at collections of random numbers.

Make a list of 10 random real numbers between -1 and 1:

In[]:=

RandomReal[{-1,1},10]

These random numbers are uniformly distributed, so if we make a histogram of them, it’ll be flat.

Make a histogram of 1000 random numbers between -1 and 1:

In[]:=

Histogram[RandomReal[{-1,1},1000]]

With 100,000 numbers the histogram is almost exactly flat:

In[]:=

Histogram[RandomReal[{-1,1},100000]]

Now let’s start finding means of collections of numbers.

This finds the mean of 10 random real numbers:

In[]:=

Mean[RandomReal[{-1,1},10]]

Here is a list of 10 such means:

In[]:=

Table[Mean[RandomReal[{-1,1},10]],10]

Here is the distribution of 1000 such means:

In[]:=

Histogram[Table[Mean[RandomReal[{-1,1},10]],1000]]

Here is the distribution for 100,000 means:

In[]:=

Histogram[Table[Mean[RandomReal[{-1,1},10]],100000]]

The distribution for the means is not flat; instead it’s a bell-shaped curve.

It’s easier to see the shape of the curve if we use smaller bins; here width 0.01:

In[]:=

Histogram[Table[Mean[RandomReal[{-1,1},10]],100000],{.01}]

If we only put 5 numbers into the mean, we still get a very similar result:

In[]:=

Histogram[Table[Mean[RandomReal[{-1,1},5]],100000],{.01}]

The crucial thing about the Central Limit Theorem is that it holds for a wide range of different underlying random distributions.

If we cube each random number, the distribution of the results isn’t flat:

In[]:=

Histogram[Table[RandomReal[{-1,1}]^3,1000]]

The distribution of the means is still the same shape:

In[]:=

Histogram[Table[Mean[Table[RandomReal[{-1,1}]^3,10]],100000],{.01}]

If we square each number, we’ll always get results that are positive:

In[]:=

Histogram[Table[RandomReal[{-1,1}]^2,1000]]

The distribution of the means is still the same shape, though its center (mean) is shifted:

In[]:=

Histogram[Table[Mean[Table[RandomReal[{-1,1}]^3,10]],100000],{.01}]

## The Normal Distribution

The Normal Distribution

## Towards the Normal Distribution

Towards the Normal Distribution

## The Normal Distribution in 2D and Beyond

The Normal Distribution in 2D and Beyond

## Random Walks

Random Walks

## What Isn’t a Normal Distribution

What Isn’t a Normal Distribution

Further Explorations

Investigate the rate of convergence to the normal distribution

Investigate the distributions of the largest digits in powers of 2

Authorship information

Stephen Wolfram

2017/05/13