Thanks for the follow-up. I assume you think it should be disallowed to pass a new weight kernel with a different number of filters, since the original layer was initialized with another number of kernels?
If so, then note that it’s not disallowed to manipulate the underlying parameters (at your own risk).
While this might be prone to potential bugs, I would consider this an advanced approach and don’t think we should disallow it as it could limit potentially valid use cases.