Performance, Pytorch, Deep Learning, Artificial Intelligence, Tensorboard.
clearly see that our 1.3 second long training step is completely dominated by the torch.nonzero operator in the first line of our loss function. All the other operations appear bunched together on either side of the huge cudaMemcpyAsyn event. What is going on??!! Why would such a seemingly innocent