Optimization, Pytorch, Machine Learning, Deep Learning, Tensorboard.
of code. Performance Issue of Weights Definition as Seen in Trace View (Captured by Author) In the loss function, as it is currently defined, we are copying the weight vector into the GPU in every training step. Being that our weight vector is constant, this seems highly wasteful. Optimization #1: