Thank you so much!
That thread help me a lot. What i have encountered is quite similar to your case.
So, now I’m sure that there is nothing wrong with my environment and my implementation.
However, in that case, how should I choose my batch_size? Before, I increase batch_size until the GPU utilization up to max in nvidia-smi, which turns out to be not referable.