Solved by ptrblck in post #2 
              
              
                Could you post your training code so that we can have a look and debug it? 
Sometimes some hyperparameters are off, e.g. a too high learning rate was used.