Pytorch, Optimization, Deep Learning, Artificial Intelligence, Tensorboard.
part 2 of our series, these operations typically indicate that data is being copied from the host to the device — something that we would like to avoid mid-training-step. At this point you will naturally ask: Why is this happening? And what part of our model definition is causing it? The