As in linear activation function we use the hidden layer size and output size so how we will give the hiiden layer size and output size in relu function?
self.linear = nn.Linear(hidden_layer_size, output_size)
As u guided to use the self.relu = nn.ReLU()so i tried and i cannot see my loss is changing its getting same on every epoch:
epoch:   1 loss: 0.88755035
epoch:  26 loss: 0.88755035
epoch:  51 loss: 0.88755035
epoch:  76 loss: 0.88755035
epoch: 101 loss: 0.88755035
epoch: 126 loss: 0.88755035
epoch: 149 loss: 0.8875503540