i will try to run your code and replace the with torch.no_grad() with volatile=True since the pytorch i’m using is not compiled from the source code.
how can i check if my stage 1 models get gradients?