I would have the same assumptions and also think that something might not work as expected.
Did you just recently encountered this issue and was it working before?
Also, which PyTorch version are you using?