Solved by ptrblck in post #5 
              
              
                Again, I would recommend to play around with hyperparameters, such as the learning rate. 
Since the loss changes and no dropout (or other “random” operations are used), it would mean that the parameters get some updates but the overall training isn’t able to reduce the loss. 
Start by using a lower …