@pritamdamania87  Thanks.
So you said me to find the cause of late H2D.
I found the solution. When I give the option of workers to 5. it was operated well i expected. My system has 1 node at 4GPU, so I gives workes=4 which affects the performance of other GPUs. I can’t find why DGX allocated more workers than other system. But I checked the profiler, it seems correct.
My concerns is more allocated the worker makes any other problem?