I assume  you don’t want to retrain these parameters?
If so, you could simply freeze them by setting their .requires_grad attribute to False.
Alternatively, you could register them as buffers via self.register_buffer(name, tensor).