Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
extreme example of resource under-utilization that often (though not always) indicates an opportunity to boost performance. One way to control the memory utilization is to increase the batch size. In the image below we display the performance results when we increase the batch size to 512 (and the