The limits of central limit theorem – part 2

In the previous part we made look through the distribution of sample means for three distributions: Uniform, Cauchy, and Petersburg distribution. The Cauchy and Petersburg distributions do not fulfill the Central Limit Theorem since they have infinite variance (and infinite expected value in “Petersburg” case). Now we will have a look at the numerical results for standard deviation of sample means. As in previous part, we use Uniform distribution only as a reference since it fulfills CLT and we use the same pseud-random number generator (Mersenne-Twister).

Uniform distribution, gives a really nice impressions when looking through the chart showing standard deviation \(\sigma\) vs sample size \(n\):

Standard deviation for distribution of sample means as a function of sample size

It behaves as we expected – in accordance to the CLT – it varies like: \(\frac{1}{\sqrt{n}}\).

And now – stars of our show – Cauchy distribution:

Standard deviation vs sample size for distribution fo sample means

…and Petersburg distribution:

Standard deviation vs sample size for distribution of sample means

In spite of trying many different pseudo-random generator seed values the result is the roughly the same – \(\sigma(n)\) does not seem to converge.

Conclusions:

Since distributions of sample means for the Cauchy and Petersburg distributions do not fulfill the assumptions of CLT – we didn’t expected the same result as in “properly behaving distributions” like uniform distribution. In spite we didn’t discover anything new with our “experimental statistics”, we he had a lot of fun and wanted to share it with you.

Mikołaj Sitarz, 2018

Leave a Reply

Your email address will not be published. Required fields are marked *