Nutsy:

however when I use “Model.state_dict()”, my tensors have the “requires_grad” attribute set to False.


This is expected, as you would use the state_dict to initialize a model, thus these tensors don’t store any Autograd history.



 Nutsy:

If I loaded those layers, am I able to load them in as is or do I still have to explicitly load them with “no_grad()” while having codes that set their “requires_grad” attribute to False?


You can just load the state_dict via model.load_state_dict(state_dict) without the no_grad() guard.