@tom Thanks for your response.
These are bit of new concepts for me. But, what I understand is that the CPU memory usage will be high whenever we train a model on GPU.
I have one more question. When I increase num_workers to 4 in DataLoader, each 4 process is taking high CPU memory (as I mensioned above ~2.3GB)?? Is it normal then?