Pytorch, Deep Learning, Optimization, Tensorboard, Deep Dives.
Loading in the Trace View Tab (Captured by Author) To address this, we will apply another PyTorch-recommended optimization for streamlining the data input flow, memory pinning. Using pinned memory can increase the speed of host to GPU data copy and, more importantly, allows us to make them