Events (Since covid these events are taking place online.)

Yule’s “Nonsense Correlation” Solved!

Tuesday, April 02, 2019 at 11:50am - 12:55pm

Philip Ernst - Rice

In this talk, I will discuss how I recently resolved a longstanding open statistical problem. The problem, formulated by the British statistician Udny Yule in 1926, is to mathematically prove Yule’s 1926 empirical finding of “nonsense correlation.”  We solve the problem by analytically determining the second moment of the empirical correlation coefficient of two independent Wiener processes. Using tools from Fredholm integral equation theory, we calculate the second moment of the empirical correlation to obtain a value for the standard deviation of the empirical correlation of nearly .5. The “nonsense” correlation, which we call “volatile” correlation, is volatile in the sense that its distribution is heavily dispersed and is frequently large in absolute value. It is induced because each Wiener process is “self-correlated” in time. This is because a Wiener process is an integral of pure noise and thus its values at different time points are correlated. In addition to providing an explicit formula for the second moment of the empirical correlation, we offer implicit formulas for higher moments of the empirical correlation. The paper appeared in The Annals of Statistics and can be found at https://projecteuclid.org/euclid.aos/1498636874 Click or tap if you trust this link.">https://projecteuclid.org/euclid.aos/1498636874
Location   Hill 705