oh my, I just found the line

torch.set_grad_enabled(False)

somewhere in global settings which actually caused the problem!
and yes - loss.requires_grad = True need to be removed - good catch!
Thank you for your help! I appreciate it!