Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
Optimization #3: Increase Batch Size For our next optimization, we draw our attention to the Memory View of the last experiment: Memory View in TensorBoard Profiler (Captured by Author) The chart shows that out of 16 GB of GPU memory, we are peaking at less than 1 GB of utilization. This is an