Error : 0404_GDAAlgorithms: Gradient normalisation for NAG and Momentum

[sanjayk]

In code above( [0404_GDAAlgorithms]), for both Momentum and NAG, dw and db's are not being normalised (division with number of data points).
Is this how it is supposed to be or just a writing error?

[Ishvinder]

Hi @sanjayk,
Yes, It is a typing error i guess.
They should have been normalised instead.