Solved by kyoto in post #2 
              
              
                I alreay found the error, don’t know if I need to take the post down or not, but just in case someone has the same problem as me, what I did was reduce the batch size. It seems that using a high number for batch size makes the gradients go down a lot, so the weights don’t improve during training. Th…