I did benchmark in https://github.com/u39kun/deep-learning-benchmark 4 and results are below. Is there a way other than to increase number of workers in the data loader?
rtx 2080




Framework
Precision
vgg16 eval
vgg16 train
resnet152 eval
resnet152 train
densenet161 eval
densenet161 train




pytorch
32-bit
39.3ms
127.5ms
62.3ms
211.8ms
65.8ms
206.8ms


pytorch
16-bit
27.8ms
98.4ms
38.0ms
144.2ms
43.7ms
154.6ms



gtx 1080




Framework
Precision
vgg16 eval
vgg16 train
resnet152 eval
resnet152 train
densenet161 eval
densenet161 train




pytorch
32-bit
55.2ms
171.0ms
83.6ms
279.6ms
86.3ms
289.2ms


pytorch
16-bit
47.2ms
152.7ms
65.0ms
235.4ms
66.3ms
237.7ms