Thank you for the quick reply (appreciated).
My batch_size = 8,
because the length of train_data sample is very long.
I will get the error message (out of memory ) when I only use one gpu.
So,  I plan to use the multi-gpus to train my model.
However, the model only use the gpus 0 when gpus= [0, 1].



 ptrblck:

If the batch size is too small, some GPU won’t be able to get a data chunk.


In general, batch_size be equal to ?
Could you give me some advice, thank you.