Thank you for the detailed answer @KFrank! 
So, it’s all because of overheating. GPU memory or Power input has no role to play here?
I’ll look for a cooling pad now. Is there anything else I can do from PyTorch to alleviate this?