Scale Ai, Tutorial, Pytorch, Machine Learning, Data Science.
image loading bottleneck that causes the average batch time to spike to almost 20 seconds (when using the largest batch size), while the async streaming code took less than a second on average. Training becomes much more efficient since we are able to keep the GPUs saturated even as our batch sizes