For my use case, I think the correct answer is to use self.register_buffer instead of nn.Parameter.
As for the title, I don’t know if that combination has any use cases (and hence does not need to be supported) or is a bug.  IMO, it should at least be documented with a warning of some sort.