Optimization, Pytorch, Machine Learning, Deep Learning, Tensorboard.
improve performance, it can also reduce the accuracy of time measurements. For the purposes of our blog post we will rely on the step times reported by PyTorch Profiler. For some of our experiments we will introduce an artificial synchronization event to force host-device alignment. Initial