Covariance

The extent of the relationship between two variables. It is an inherently algebraic concept and cannot be defined without reference to algebra. Where variables have been normalized the covariance is equal to the correlation.

The covariance between two jointly distributed numeric random variables, X and Y with expectations is defined as:

$Covariance(X,Y)=\mathrm{E}[(X-\mathrm{E}[X])(Y-\mathrm{E}[Y])]$

Where $x_i$ and $y_i$ are the realized values of X and Y in a sample of n observations and $\overline{x}$ and $\overline{y}$ are their respective means, the sample covariance is estimated as:

$Covariance(x,y)=\frac{1}{n-1}\sum _{i=1}^n(x_i-\overline{x})(y_i-\overline{y})$