You pass mod.parameters() to the optimizer right? While the state dict is mod.state_dict() which is what you save. And what you save contains the buffers.
Usual buffers we use are for example the running statistics of batchnorm.