1. Linear Models The target value is expected to be a linear combination of the features. 1.1. Ordinary Least Squares (OLS) The OLS is a optimization math technique that aim to find the better adjustment for a set data and try to minimize the residual sum of squares between the observed targets in the dataset and the targets predicted by the linear approximation. from sklearn import linear_model reg = linear_model.