Pinterest, Engineering, Infrastructure, Open Source.
set of benchmarks by training models on the same model architecture while progressively increasing the Last Mile Data Processing workloads. To our surprise, the Ray dataloader showed a 20% improvement in the training throughput even without any Last Mile Data Processing. Ray dataloader handled