It works fine, thank you.
Just realised that the problem wasn’t pytorch-wise.
I had a saved matrix-variable with the same name in the environment of python which was (6*6)  so the null space of it was always Zero.