A better error message would surely be useful.
However, I don’t know if forcing contiguous tensors would break other use cases and as you’ve described before, some optimizers seem to work fine with non-contiguous tensors.