Could you try to time your data loading using data_time from the ImageNet example 3?
Alternatively, could you just time the transformations?
Since they seem to perform some OpenCV workload it might be the bottleneck.