Sigmoid Neuron Loss Curve

Why I am getting such a unstable loss function for Sigmoid Neuron problem when learning rate is 0.01? (blob dataset)image

1 Like

Hi @Gaurav_Kandel,
This is the case because it’s overshooting the global minima. Please try with a smaller learning rate.