Solved by smth in post #2 
              
              
                did your training accuracy drop / fail a lot after you removed the Sequential? 
I looked at your code and didn’t see anything obvious. 
Some things to look for are to see if the number of parameters in your model is the same before and after. You can do this with: 
num_params = 0
for p in model.para…