Using lmdb database datasets would give good increase in performance.
Using 4 GPUs will not give 4X speedup.(Amdahl’s law). It’s usual that performance with 4 GPUs is same as single GPU. In distributed training, there’s lot of communication between GPUs and CPU which hinders performance gains.