Do you need to call backward at some time?
If not, you could wrap your code in a with torch.no_grad(): block to save some memory.
It depends on your forward method, since your nn.Sequential module will only contain the children without the actual forward implementation.
Could you post your model code so that we could have a look?