def model(x):

a1=torch.matmul(x,weights1)+bias1

h1=a1.sigmoid()

a2=torch.matmul(h1,weights2)+bias2

h2=a2.exp()/a2.exp().sum(-1).unsqueeze(-1)

return h2

weights1=torch.randn(2,2)/math.sqrt(2)

weights1.requires_grad_()

bias1=torch.zeros(2,requires_grad=True)

weights2=torch.randn(2,2)/math.sqrt(2)

weights2.requires_grad_()

bias2=torch.zeros(2,requires_grad=True)

When I am trying to apply my input using the above model,

I am getting same output for each and every training example.

What should I do??

Please Help.