Solved by BaruchG in post #3 
              
              
                I’m not sure exactly where your model is going off, but you can find a more standard approach for working with mnist at https://pytorch.org/tutorials/beginner/blitz/neural_networks_tutorial.html#sphx-glr-beginner-blitz-neural-networks-tutorial-py if that is helpful for your use case.  One thing that…