Solved by ptrblck in post #5 
              
              
                The fluctuating loss behavior might come from your hyperparameters, not from a code bug. 
Did the model architecture work in the past with your kind of data? 
Your model is currently quite deep, so if you started right away with this kind of deep model, the behavior might be expected. I’m usually th…