Why is leaky relu said to be close to zero centered?

Why is leaky relu said to be close to zero centered and not zero centered or non zero centered?

1 Like

It might be the matter of fact that zero centered activation functions are widely preffered, and quoting one as close to zero centered looks like a plus point. :sweat_smile: Might look a silly reason though, but just a guess.
Would try to look for a better reason anyway, and get back to you.

1 Like

Thank U…
It make sense to say close to zero centered bcz we give weight as 0.01 for negative values… But still if we consider zero centered symmetry it looks wrong…