Another difference appears to be that for all learnable parameters which appear in both model.state_dict() and model.parameters(),  requires_grad is True in the model.parameters() output and False in the model.state_dict() output.
Why is this?