Scale Ai, Tutorial, Pytorch, Machine Learning, Data Science.
training speed was bottlenecked by the speed of each data request (which introduces significant latency when loading training data from a cloud object store such as GCS or S3). This latency can be negated using concurrency, i.e. latency hiding. We evaluated several options for concurrency in Python