1. 6.1.1 Deriving OLS
OLS is obtained by minimizing the sum of the square errors. This is done using the partial derivative 6

2. 6.1.1 Deriving OLS
These can simplify to: 6

3. 6.1.1 Deriving OLS
These can be expressed in their normal equations form:
Notice that we have two equations with two unknowns (β2hat and β1hat). All other components come from our data set.
After some math, we get the OLS estimates of β1hat and β2hat: 6

4. 6.1.1 Deriving OLS
Finally, we check the second derivative to confirm a minimum. 6

5. 6.2 OLS Estimators and Goodness of Fit
On average, OLS works well:
The average of the estimated errors is zero
The average of the estimated Y’s is always the average of the observed Y’s
Proof:
Note: This comes from our derivation of OLS as the sum of squared errors. 6