Medium – 15 Oct 18
  
  
    

💥 Training Neural Nets on Larger Batches: Practical Tips for 1-GPU, Multi-GPU... 37

Training neural networks with larger batches in PyTorch: gradient accumulation, gradient checkpointing, multi-GPUs and distributed setups…

  Reading time: 9 min read