I'm not sure why you need to multiply by $\frac1{2m}$ in the beginning. I understand that you would have to divide the whole sum by $\frac1{m}$, but why do we have to multiply $m$ by two?
Is it because we have two $\theta$ here in the example?
Asked
Active
Viewed 2.1k times
2 Answers
23
It is simple. It is because when you take the derivative of the cost function, that is used in updating the parameters during gradient descent, that $2$ in the power get cancelled with the $\frac{1}{2}$ multiplier, thus the derivation is cleaner. These techniques are or somewhat similar are widely used in math in order "To make the derivations mathematically more convenient". You can simply remove the multiplier, see here for example, and expect the same result.
TwinPenguins
- 4,157
- 3
- 17
- 53
-
Thanks for your clean answer! But doesn't this affect the result at all? – Marton Langa May 18 '19 at 14:11
-
3Not at all. It is a simple constant. After it is a convex function, and will lead to a global minima! – TwinPenguins May 18 '19 at 15:13
7
It makes the math easier to handle. Adding a half or not doesn't actually matter since minimizing is unaffected by constants.
Kane Chua
- 106
- 2