The theory presented in this work forms the basis of many algorithms for parameter estimation, adaptive system identification, and adaptive filtering. It covers the mathematical tools required for linear prediction algorithms, the relationships between approaches and recent research results.