Thank you for the instructions and sorry for the delayed reply.
I failed to reproduce the results I mentioned from the beginning. The usage of GPU is increasing now.
I am just using a really small toy model. And I keep typing command nvidia-smi to check the memory usage.
Thank you so much!