Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
memory utilization to 11.3 GB). Results of Increasing Batch Size in the TensorBoard Profiler Overview Tab (Captured by Author) Although the GPU utilization measure did not change much, our training speed has increased considerably, from 1200 samples per second (46 milliseconds for batch size 32) to