Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
non-blocking: inputs, labels = data[0].to(device=device, non_blocking=True), \ data[1].to(device=device, non_blocking=True) The results of the memory pinning optimization are displayed below: Results of Memory Pinning in the TensorBoard Profiler Overview Tab (Captured by Author) Our GPU utilization