Will check my network with torch.autograd.gradcheck.gradcheck.
However isn’t it weird that my network works when I use loss(tensor, truth) but not with loss(warped_tensor, warped_truth)  where warped_truth was applied the exact same transformation.
I will try to provide you with some executable code soon.