You can check the .requires_grad attribute of all parameters, which should be frozen, and make sure it’s returning False and could additionally check that their .grad attribute is None after a  backward operation.