Is data augmentation done in a single thread even when data loader is multi-threaded with num_workers > 2?

  
      Sagivtech
  
  
    

Optimizing PyTorch training code 637

Ben Levy and Jacob Gildenblat, SagivTech    

PyTorch is an incredible Deep Learning Python framework. It makes prototyping and debugging deep learning algorithms easier, and has great support for multi gpu training.
However, as always with...