I solved this problem by reinstalling with cuda version 10.0
Before I installed pytorch with cuda version 9.0. It not worked properly and my model not utilized gpu.
Previous version detected my gpu by it is not able to utilize it.
So I suggest to be in latest version of cuda
Thanks for helping me.