Yep, should work. Parameter is literally a Tensor with the convenience of automatically registering that tensor as a trainable parameter. If you leave it as a tensor, it won’t show up in your module.parameters().