On: An Introduction to Gradient Descent and Linear Reg...

[jmalicki]

Actually, although the direct method is often faster than gradient descent, it is not faster than conjugate gradient.

And conjugate gradient is more numerically stable. So the question is, why would anyone competent use the direct method for linear regression?