Thank you very much for replying and for the solution.
As you have advised, I have wrapped my testing code with torch.no_grad(). I just did a small training and with that the testing. And it seems the problem is solved! But, now I will be doing longer training and then testing and will post the update here.
Again, thank you, very much