Residual vs Error

Residual vs Error

The residual is the difference between the predicted and the observed value in the sample. 

The residual measures how wrong our prediction was for a given observation. 

The error is the difference between the predicted and the observed value in the population. 


The goal of OLS is to minimize error or how wrong our predictions are expected to be in the population.