for reference, I ran the experiment on my device with the below mentioned configurations
This is the output and time taken by 100 iterations in an each epoch. In each iteration, there are 4 examples.
Configuration of device: GTX970
batch_size = 4
number_of_workers = 4

Screenshot from 2019-10-28 18-22-38.png1920×1080 217 KB