Thank for your reply and sorry for my bad writing as well.
The main point here is processing time for batch size 1 (1 GPUs) is 0.48s, and that for batch 8 (8 GPUs) is 3.7s. There is no parallel processing at all.
I think feeding a list into the model is the main reason, then I would like to get help from you and other Pytorch experts.